Fetching from the wire…
Public story · 2026-08-10 · high
The gain comes from verifying bug fixes by reproduction, not by trusting the agent's own claim, and it holds across three different model backends.
Why now: The paper posted to arXiv in August 2026, and PMCoder's numbers haven't been independently checked yet.
PMCoder resolved 25 more SWE-bench Verified cases by refusing to trust its own "finished" claim, per a study posted to arXiv. That's a 5.0-percentage-point gain over a harness-matched baseline, and it holds across three different backends: Claude Haiku 4.5, DeepSeek-V4-Flash, and an OpenHands port. For teams building coding agents, the backend matters less than whether the harness checks its own work.
The system couples two things agent harnesses usually keep separate: planning and episodic memory. The plan phase now conditions what gets pulled from memory. Memory-derived trajectory stats decide when the agent's stuck and needs a new plan, instead of letting it grind on a broken approach.
The bigger break from convention is verification. PMCoder doesn't accept an agent's self-report that a bug is fixed. It checks whether the reported issue actually reproduces, or stops reproducing, after the patch. On the smaller Verified-500 subset, the gain held at 2.8 percentage points or better across all three backends, per the paper. It doesn't say what the added memory and replanning loop costs in tokens or latency.
Each link below shares sources, entities, or timing with this story.
OpenHands uses GPT / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (OpenHands uses GPT); both cover DeepSeek, Flash, OpenHands, Verified; reported by the same outlet (arxiv.org).
DeepSeek released DeepSeek V4 / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (DeepSeek released DeepSeek V4); both cover DeepSeek, Flash, SWE, Verified; earlier DeepSeek coverage from 2026-06-15.
DeepSeek partners with Huawei / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek partners with Huawei); both cover DeepSeek, Flash, SWE, Verified; earlier DeepSeek coverage from 2026-04-26.
OpenHands uses Claude / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (OpenHands uses Claude); both cover DeepSeek, SWE; reported by the same outlet (arxiv.org).
DeepSeek competes with Anthropic / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (DeepSeek competes with Anthropic); both cover SWE, Verified; reported by the same outlet (arxiv.org).
OpenHands uses GPT / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (OpenHands uses GPT); both cover OpenHands, SWE; reported by the same outlet (arxiv.org).
DeepSeek released V4-Flash / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek released V4-Flash); both cover DeepSeek, Flash, Verified; earlier DeepSeek coverage from 2026-08-02.
DeepSeek released V4 Preview / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek released V4 Preview); both cover DeepSeek, Flash, SWE; earlier DeepSeek coverage from 2026-04-24.