Cleaner Agent Memory Doesn't Mean Smarter Answers

Better-organized agent memory doesn't produce better answers, per arXiv paper 2607.26637. That's real money for builders: organizing a memory store cuts retrieval costs roughly in half once the material gets large.

The setup is already how most production agents keep long-term memory. It's a directory tree of markdown files the agent reads, writes, and reorganizes with generic file tools. The paper tested the setup across three roles: management, search, and execution.

Organization erodes over time for nearly every agent tested, drifting back toward disorder. One management agent held on to a cleaner structure than the rest, though the paper doesn't say why.

The bigger point holds regardless of decay: cost, structure, and output quality were tracked separately, and organization never predicted the last one. Not for the agent that stayed tidy, not for the ones that let their directories rot.

That decouples two things builders tend to treat as one: a clean memory store isn't a proxy for a smarter agent. If an agent's memory directory is degrading, the fix is auditing which file primitives it has, not upgrading the model.