Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-25 · high
Gains run 9.0 to 10.0 points across three benchmarks, and the paper's ablations show which design choices earned them.
Why now: The paper posted August 25.
AutoSaddler turns failure traces from an agent's tool harness into validated patches for that harness, per the AutoSaddler paper. Most agent harnesses only get better when someone reads a trace by hand and edits a prompt. AutoSaddler runs that fix loop itself, checking each patch against a batch of past failures before keeping it.
Gains run 9.0 points on GAIA2, 9.6 on SWE-Bench Pro, and 10.0 on Terminal-Bench 2.0, against the harness's starting point. The paper doesn't give those starting scores, and it isn't comparing AutoSaddler to a rival system.
Its ablations point at what carries the result. Deep debugging beats shallow reflection, targeted edits beat open-ended rewrites, and validating patches across batches of failures beats scoring them per trajectory.
I'd want to know whether patches that pass validation on one batch of failures still hold a month later on a fresh batch. The paper doesn't say, and that gap matters if you're running a harness daily instead of testing it once.
Each link below shares sources, entities, or timing with this story.
Shared entities / Shared topic / Earlier coverage / Tension
Both cover Bench, Bench Pro, SWE, Terminal; overlapping topics (agent, code); earlier Bench coverage from 2026-06-10.
Both cover Bench, Bench Pro, SWE, Terminal; overlapping topics (agent, benchmark); earlier Bench coverage from 2026-04-21.
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover Bench, Gains, Terminal; reported by the same outlet (arxiv.org); overlapping topics (agent, gain, harness).
Shared entities / Shared topic / Earlier coverage
Both cover Bench, Bench Pro, SWE, Terminal; overlapping topics (agent, benchmark); earlier Bench coverage from 2026-07-13.
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover Bench, Gains, SWE; reported by the same outlet (arxiv.org); overlapping topics (agent, benchmark).
Shared entities / Earlier coverage / Tension
Both cover Bench, Bench Pro, SWE, Terminal; earlier Bench coverage from 2026-07-14; pushes against this story (versus).
Shared entities / Shared topic / Earlier coverage
Both cover Bench, Bench Pro, SWE; overlapping topics (agent, benchmark, code, over); earlier Bench coverage from 2026-04-08.
Shared entities / Same source domain / Shared topic / Earlier coverage / Downstream implication
Both cover Bench, Gains; reported by the same outlet (arxiv.org); overlapping topics (code, edit, over).