A macOS computer-use agent replaced the vision model with OCR plus a classifier and claims $0.0002 per step.

typesafe-computer-use, created September 16 and at 128 stars, screenshots the frontmost window, OCRs it deterministically, merges text blocks with accessibility-tree controls into one numbered list, then asks TypeSafe to pick among three mutually exclusive next actions. Measured decision latency 0.13 to 0.38 seconds against roughly 5.2 for Claude Opus, end-to-end steps ~1.5s against ~5.5s. The cost claim rests on TypeSafe returning probability distributions over choices without charging for generated tokens, which is a real structural difference and also the thing to verify before you build on it.