Fetching from the wire…
Agents2026-09-14 · source-backed
A contamination-controlled 256-task private suite tested vendor-native harness-model pairings against a neutral harness. Aggregate differences were trivial: 1.25 points either direction. Split by task type, the native harness trailed by 9.0 points on repository tasks and led by 23.7 on contest tasks, and the neutral harness cost 1.3-1.6x more per solved task on Opus 4.8. Most production work is repo-shaped, which means the harness optimized for the benchmark you read about is the wrong one for the work you do.
Each link below shares sources, entities, or timing with this story.
Runta published FrontierHarness on September 2 and it's the most directly useful benchmark I've read this quarter, because it controls the one variable everyone conflates. Nine agent harnesses (Codex, Claude Code, OpenCode, Pi, Oh My Pi, DeepSeek Harness, Kimi Code, Exo Harnes...
xAI launched Grok 4.5 and Grok Build on July 8, trained partly on Cursor developer-session data. The numbers are loud: 83.3% on Terminal-Bench 2.1, 64.7% on SWE-Bench Pro, priced at $2/$6 per million tokens. On a single coding task that works out to roughly $2.49 versus $11.80...
Within five days of each other, both Claude Code (v2.1.158, May 31) and Cursor (3.6, May 29) shipped remarkably similar architectures for autonomous agent execution. Both use a classifier subagent that reviews each pending action against conversation context and decides: allow...
$3,054 against $38,370. Same benchmark, better score. Praxist (arXiv 2608.25955, submitted August 26) replaces per-attempt agent memory with a typed evidence graph of findings, plus lane-structured frontiers and agendas, so later attempts inherit validated mechanisms rather th...
Everyone spent yesterday arguing about benchmark numbers. Tencent quietly published data suggesting the numbers belong to your infrastructure, not the model. The WorkBuddy Bench leaderboard reports every model under two different agent harnesses — CodeBuddy Code and Claude Cod...
The trick is one line in a file you never read. Manifold Security published eight findings across seven coding agents (Claude Code, Codex, Cursor, Grok Build, Qwen Code, goose, Hermes Agent) that all reduce to the same mechanism. A repository's own .git/config sets core.fsmoni...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.