Fetching from the wire…
Public story · 2026-08-04 · high
SWE-Touch injects conflicting edits mid-task, and models fail by keeping or blindly overwriting the conflict.
Why now: This finding is part of the August 4, 2026 coverage, and it's the spread across nine models and three benchmarks that makes it hard to write off as a one-off.
Coding agents lose 7.7 points of resolve rate when a human edits their target files mid-task, per a new benchmark called SWE-Touch. I edit files while Claude Code works in the background on almost every project I ship, so this isn't abstract.
SWE-Touch mines task-critical code regions from past repair trajectories. It builds a plausible Counter-Edit that conflicts with the task. Then it drops that edit into the repo with a contextual message right as the agent reaches that region.
The drop holds across nine models on SWE-bench Verified. It isn't one model's quirk, since the same failure pattern persists on SWE-Bench Pro and DeepSWE, detailed in arXiv:2608.02499.
Trajectory analysis found two failure patterns. Some agents keep the conflicting code exactly as it landed. Others overwrite it and move on without re-checking the rest of the repo.
The paper doesn't test whether forcing a fresh repo diff before every write would close the gap. But the failure pattern points at a process problem. Agents that never re-inspect the repo after a conflicting edit lands are the ones losing points, regardless of which model runs the loop.
Each link below shares sources, entities, or timing with this story.
arXiv 2607.27146 attacks from-scratch program synthesis, where agents get only natural-language docs and an execute-only binary as oracle. The pipeline auto-converts open-source command-line programs into source-free training environments and uses GLM-5.2 as teacher for synthe...
SWE-Prime's premise is that a successful trajectory still contains ineffective, redundant and risky steps, so SFT on all resolved runs teaches bad habits (arXiv 2608.27449). It filters at trajectory level on process quality, result quality and representativeness, then at segme...
Agent Lightning v1.0 (arXiv 2608.17528) inverts the standard agentic RL architecture, and the inversion is the whole point. Normally the training engine owns the environment loop. It drives the agent, collects trajectories, computes rewards. Which means your training setup and...
While the capability stories pile up, here's the counterweight. As SWE-bench Verified scores cluster near saturation on July leaderboards, an enhanced analysis (SWE-Bench+, on the AIware 2026 benchmark track) found 60.83% of commonly resolved issues contain solution leakage ri...
A June paper shows source code is the dominant token sink for state-in-context SWE agents, and minification (stripping non-essential lexical elements, preserving semantics) cuts average input tokens 42% for only a 12-point SWE-bench Verified drop. Public on GitHub. For agents...
- Source: VALS AI - Category: benchmark - Date: 2026-02-05 Opus 4.6 (Thinking) leads SWE-bench Verified at 79.2%, but SWE-Bench Pro (~23%) and SWE-EVO (19-21%) reveal significant gaps. Current coding agents excel at well-defined single-repo issues but struggle with cross-langu...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.