Fetching from the wire…
Public story · 2026-09-12 · high
The 4B-parameter system tops the strongest sequential-memory baseline by 5.7 points on average across context lengths from 7,000 to 896,000 tokens.
Why now: The paper posted to arXiv in September, as more teams try to scale agents past million-token documents without retraining every part of the system.
PARSER splits reading a long document across a bank of frozen subagents, then trains only the lead agent that directs them.
That split matters because retraining every part of a long-context system is what makes it expensive to scale. PARSER keeps all the learning in one coordinator and leaves the readers as off-the-shelf models. Adding more subagents doesn't mean retraining more of them.
Each subagent reads one chunk of the document in parallel and never changes. The lead agent runs scatter-gather rounds. It broadcasts a question to the subagents, gathers what comes back, and forms a deeper follow-up, repeating until it has enough evidence to answer. Reinforcement learning trains that lead agent's behavior; nothing else in the system does.
With a 4B-parameter backbone, PARSER beats the strongest sequential-memory baseline by 5.7 points on average across context lengths from 7,000 to 896,000 tokens. At the top end, 896,000 tokens, the gap grows to 12.0 points, according to the PARSER paper.
The gap widens at the longest context. Sequential memory systems tend to degrade as documents grow, since each new chunk has to be folded into whatever the system remembered so far. PARSER's readers don't carry that burden forward. They just answer what the lead agent asks. If that holds outside this benchmark, most long-context agent products are training their readers when they should be training the one agent that queries them.
Each link below shares sources, entities, or timing with this story.
The diagnosis in this paper is better than the fix, and the fix is very good. Recurrent memory agents fail at long context, but not for the reason most people assume. The bottleneck isn't capture. It's retention. Retention falls below 30% at 896K tokens because every consolida...
CLR is a training-free test-time framework that stops generating whole competing solutions and instead verifies the specific decision-critical claims inside a reasoning trace (arXiv 2608.11994). It exploits an asymmetry you can reason about directly: a correct solution needs e...
arXiv 2607.29032 converts sparse historical hidden states into reusable memory representations via a gating network intervening on current hidden states, all at inference time with no context reprocessing. Training uses evidence-conditioned self-distillation: a memory-augmente...
MoT asks whether pretraining can decompose into small independently schedulable jobs. It partitions a Transformer into contiguous layer blocks, trains each inside a frozen pretrained aligner scaffold, then recomposes with an optional short end-to-end adaptation pass (arXiv). O...
arXiv 2608.06370 evaluated models emitting code that calls tools against JSON-schema tool calling on BFCL v4. PTC matched or exceeded the baseline in 11 of 14 models, with the GPT-5.6 family up 10.6%, and held stable under parallel execution in 13 of 14. Under context degradat...
Engram, a bi-temporal memory engine, scored 83.6% versus 73.2% for a full-context baseline on the 500-question LongMemEval_S benchmark, a statistically significant +10.4 points, while using ~9.6k tokens instead of 79k (arXiv 2606.09900). Roughly 8x fewer tokens and more accura...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.