Fetching from the wire…
Public story · 2026-07-21 · high
Same passing result cost 10,565 dollars on GPT-5.5 alone, a 7.9x spread that comes down to which moments get the expensive model.
Why now: Cursor published the research on July 20, alongside a separate 3.1-million-rollout study on agent harnesses covered in the same briefing.
Cursor had a team of agents rebuild SQLite in Rust using only the 835-page manual. No source code, no test suites, no internet. The result had to pass a held-out sqllogictest suite, and it did, per Cursor's writeup from researcher Wilson Lin published July 20.
The engineering result is the headline, but the cost spread is the number worth sitting with. The cheapest model configuration finished the job for 1,339 dollars. Running everything on GPT-5.5 hit 10,565 dollars. Same task, same passing outcome, 7.9 times the bill.
The routing logic behind that gap is simple: reserve frontier models for the high-judgment moments, planning, architecture, deciding what "done" means, and let cheap models handle bulk execution once the plan is fixed. Translating a settled plan into 400 files of Rust doesn't need the expensive model touching every line.
That's a real update to how I'd assumed this worked. My instinct running a scrappier version of this in my own projects was that quality collapses if the expensive model isn't everywhere. Cursor's data says otherwise: once the interfaces are pinned, the judgment already happened, and you're paying frontier prices for what amounts to transcription.
A separate study adds a complication. A UC Berkeley and MIT-IBM team ran 3.1 million LLM rollouts across 30 harness configurations on 12 model-problem pairs and found no fixed harness reliably wins. Harness choice, per that paper, is a hyperparameter you tune per problem, not an architecture you settle once.
Instrument token spend per phase in your own work, find the plan/execute boundary, then run one task twice, once with your default model mix and once with cheap models below that boundary. Diff the results. Cursor flags its own caveat: SQLite-from-manual has a spec and an oracle most real tasks lack. Whether the savings hold when the spec is a Slack thread isn't something either study answers.
Each link below shares sources, entities, or timing with this story.
Four frontier models. Five sealed engineering problems. The result everybody will quote is that Claude Fable 5 won. The result that should actually change how you work is buried three-quarters down the page. JuliaHub published an evaluation on July 30 running four frontier mod...
Two thirds. Not two thirds of a contrived jailbreak set. Two thirds of realistic malicious issue requests, against the exact three tools most of the people reading this run daily. Ankur Singh, Jinqiu Yang, and Tse-Hsun Chen built IssueTrojanBench across four attack categories...
GPT-5.6 Luna went to $0.20 input / $1.20 output per million tokens on July 30. That's an 80% cut. Terra dropped 20%. Luna's input now undercuts Gemini 3.1 Flash-Lite ($0.25/$1.50) and sits at one-fifth of Claude Haiku 4.5's $1 input. Simon Willison covered the announcement and...
$3,054 against $38,370. Same benchmark, better score. Praxist (arXiv 2608.25955, submitted August 26) replaces per-attempt agent memory with a typed evidence graph of findings, plus lane-structured frontiers and agendas, so later attempts inherit validated mechanisms rather th...
The Pragmatic Engineer published a deep read on August 25 of Inspect, the coding agent Ramp built instead of standardizing on Claude Code or Cursor. The numbers: Inspect authors 75% of Ramp's merged PRs, 90% of PRs in its own repository, passed 1 million total sessions in July...
The leaderboard says first place. The methodology says you should check your own bill. Qwen3.8 Max now ranks first on Artificial Analysis' agentic index, scoring 86.1 on OSWorld-Verified ahead of GPT-5.6 Sol Max at 83.2 and Fable 5 at 85.0, priced at $2.00/M input and $6.00/M...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.