Structured memory design boosts AI agent success rate

A new memory design lifted AI agent task success 10.7 points and cut token use 48.9% across WebArena, WorkArena, and AppWorld, per the paper. Token cost scales with context size, and the standard approach, replaying an agent's full trajectory, means context grows with every finished task. For teams running agents in production, that's the line item to watch.

The alternative stores a reusable procedure instead of the raw trace. It keeps the variable bindings that made the procedure work, the conditions under which it applies, and a check to confirm it worked. It swaps full-trajectory replay for query-conditioned structured memory, pulling up only the relevant procedure instead of the whole history.

Direct trace reuse gets worse as traces get longer, the paper found. An agent's memory degrading the longer it runs is a structural problem, not a bug to patch later.

The bet

Full-trajectory replay is still the default memory design in most agent frameworks. This paper says that default works against itself as trajectories grow, so production agents can get worse at their job the longer they run. Watch for tasks that don't break down into procedures with fixed applicability conditions, since the paper doesn't test that case.