Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-10 · high
Compressed video memory breaks because RoPE positions fall outside training range, and a training-free fix lifts recall 19.5% on a new benchmark.
Why now: WorldTrace posted on arXiv in August 2026 alongside LoopBench, the first benchmark built to isolate this exact failure.
Video world models lose memory once rollouts run past their training horizon, per the WorldTrace paper. That's a problem for anyone building agents or simulators that depend on long, coherent rollouts. WorldTrace's fix recovers up to 19.5% of that lost episodic recall on the new LoopBench benchmark.
The root cause is RoPE, the positional encoding these models use to track time across frames. Long rollouts push those offsets past the range the model trained on, so attention can't reliably address older stored content.
Naive cache compression makes it worse, per the paper. It averages positional phases that don't match, scrambling the slots meant to hold memory.
WorldTrace's fix skips retraining. It gives each compressed memory slot its own valid position instead of an averaged one. Two versions test the idea: Field, tuned for temporal coherence, and Landmark, tuned for verbatim episodic recall. On LoopBench, Field improved temporal consistency 15.5% and Landmark improved episodic recall 19.5%.
The forgetting looks like a hard memory ceiling, but it's actually a bug in how compressed positions get indexed, fixable without retraining a single weight. If that holds up, other long-context video claims are worth re-checking against how their caches assign position, not just how large the advertised window is.
Each link below shares sources, entities, or timing with this story.
Shared entity: RoPE / Shared topic / Earlier coverage
Both cover RoPE; overlapping topics (attention, rope); earlier RoPE coverage from 2026-07-29.
Shared entity: Video / Same source domain / Earlier coverage
Both cover Video; reported by the same outlet (arxiv.org); earlier Video coverage from 2026-07-25.
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (attention, cache); pushes against this story (against).
Same source domain / Shared topic
Reported by the same outlet (arxiv.org); overlapping topics (attention, cache, consistency).
Reported by the same outlet (arxiv.org); overlapping topics (attention, cache).
Reported by the same outlet (arxiv.org); overlapping topics (attention, cache).
Reported by the same outlet (arxiv.org); overlapping topics (attention, compression).
Shared entity: Video / Earlier coverage
Both cover Video; earlier Video coverage from 2026-08-07.