Fetching from the wire…
Public story · 2026-07-30 · high
It also formalizes the mechanisms most memory systems build without naming: writing, routing, and consolidation.
Why now: It surfaced in the July 30 briefing, right as I'm untangling a memory system that already mixes a vector store, a graph, and fine-tuning.
Researchers at Tsinghua and Bosch sort large language model memory into three axes, representation, update dynamics, and persistence, in a new arXiv survey.
That's the taxonomy most memory systems skip. Teams build whatever mix of vector store, knowledge graph, and fine-tuned weights feels right, then patch the mismatches once things break in production.
The paper formalizes four mechanisms most systems build ad hoc: memory writing, routing, state transitions between working and long-term storage, and consolidation. It runs twenty pages with four figures, short enough to read straight through instead of hunting for one diagram.
Its open-problems list, hybrid architectures, system-level efficiency tradeoffs, multi-dimensional evaluation, reads like a checklist for picking a memory design before writing code.
I didn't have this when I built mine. I stacked a vector store, a knowledge graph, and fine-tuning together, and I'm still working out which one owns which fact. Pick a representation before you start stacking. Sorting out the overlap after the fact costs more than the paper does to read.
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Shared entity: Twenty / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover Twenty; overlapping topics (between, design, enough).
Simon Willison released LLM / Shared entities / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM, Useful; earlier LLM coverage from 2026-07-19.
LLM uses OpenAI / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; earlier LLM coverage from 2026-07-27.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
LLM uses OpenAI / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; earlier LLM coverage from 2026-06-19.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-14.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-22.