Fetching from the wire…
Public story · 2026-07-31 · high
The fix turns quadratic SQLite log growth into linear growth for anyone storing full OpenAI-style chat histories.
Why now: The fix ships as an 0.32rc1 release candidate, not yet in the "llm" tool's stable channel.
Simon Willison shipped LLM 0.32rc1 on July 30, deduplicating conversation logs by hashing message parts instead of storing every near-identical array whole.
That's the difference between linear and quadratic storage growth for anyone logging agent traffic to SQLite over a long session.
OpenAI-style clients resend the entire growing message array on every turn. A logger that stores each turn's payload whole grows quadratically as sessions get longer. Hashing each part once and referencing it afterward keeps the growth closer to linear.
Willison also released a companion tool, llm-chat-completions-server, which exposes every model in an LLM install behind an OpenAI Chat Completions endpoint in three commands. He says GPT-5.6 Sol wrote the whole thing, with strong recall of OpenAI's own API spec.
The companion server is the bigger claim of the two. Willison credits GPT-5.6 Sol with writing the whole thing solo. But he cites the model's recall of OpenAI's spec, not a confirmed compliance check, and doesn't say how much he corrected before shipping it. Worth watching whether llm-chat-completions-server needs a patch in the next few releases, since that's the real signal on how much editing the output needed.
The dedup fix itself ships only as an 0.32rc1 release candidate, not yet in the "llm" tool's stable channel.
Each link below shares sources, entities, or timing with this story.
LLM uses OpenAI / Shared entities / Same source domain / Shared topic
Linked by a graph relationship (LLM uses OpenAI); both cover GPT, July, LLM, OpenAI; reported by the same outlet (simonwillison.net).
LLM uses OpenAI / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover GPT, July, LLM, OpenAI; earlier GPT coverage from 2026-07-26.
LLM uses OpenAI / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover GPT, OpenAI, Willison; reported by the same outlet (simonwillison.net).
LLM uses OpenAI / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover LLM, OpenAI, Willison; reported by the same outlet (simonwillison.net).
Linked by a graph relationship (LLM uses OpenAI); both cover July, OpenAI, Willison; reported by the same outlet (simonwillison.net).
Linked by a graph relationship (LLM uses OpenAI); both cover GPT, July, OpenAI; reported by the same outlet (simonwillison.net).
LLM uses OpenAI / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover GPT, July, OpenAI; overlapping topics (agent, between).
Simon Willison released LLM / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover July, SQLite, Willison; reported by the same outlet (simonwillison.net).