Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-05 · high
It skips model calls until the final answer, matching baseline accuracy on long-memory and long-context QA benchmarks.
Why now: The paper was trending on Hacker News on August 5.
Zero-Mem removes large language model calls from every step of agent memory except the final answer, cutting memory-operation time 57.6%, per the paper posted to arXiv as 2607.29377.
That matters because memory retrieval usually bills an LLM call on every lookup, even when the agent is only checking what it already knows.
The system keeps each interaction's original trace as the record. It indexes that twice: an entity-context graph linking related mentions across conversations, and a temporal hierarchy tracking session locality. A query weighs both indexes with a deterministic calibration step. It discards evidence the two disagree on, then hands the surviving record to a single reader call. Nothing before that point touches a model.
On long-memory and long-context QA benchmarks, Zero-Mem matched the accuracy of baseline systems that do call an LLM during retrieval. The paper doesn't say what building and maintaining the dual indexes costs over a long-running agent, only that querying them skips the model.
Deterministic index-and-calibrate retrieval matched LLM-mediated retrieval here. Plenty of agent memory systems may be burning inference budget on a lookup a database could handle. Watch whether the approach holds outside long-memory and long-context QA, where most agent memory actually gets exercised.
The paper was trending on Hacker News on August 5.
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Same source domain / Shared topic / Tension
Linked by a graph relationship (Simon Willison released LLM); reported by the same outlet (arxiv.org); overlapping topics (access, agent).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-27.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
Simon Willison released LLM / Shared entity: LLM / Shared topic
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (agent, call).
Simon Willison released LLM / Same source domain / Shared topic
Linked by a graph relationship (Simon Willison released LLM); reported by the same outlet (arxiv.org); overlapping topics (access, agent).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-31.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.