Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-31 · high
The same report claims a 45.9% cut to peak memory from scheduling sandboxes ahead of each tool call.
Why now: SpecBox's sandbox-preallocation numbers landed on July 31 as a fresh, single-paper claim on agent infrastructure costs.
SpecBox preallocates agent sandboxes speculatively instead of waiting for a tool call, per the SpecBox paper.
Container startup is a real tax on any agent runtime that spins up an isolated sandbox per tool call. The paper claims up to 2.9x lower P99 latency and 45.9% lower peak memory by scheduling sandbox creation ahead of the request, not on demand.
That's the kind of infrastructure lever anyone running per-call sandboxing already feels. Every extra tool call pays the container-startup cost again. Shaving that cost off the tail end of the latency distribution is where P99 numbers move.
The approach targets one bottleneck: the gap between an agent deciding to call a tool and its sandbox being ready to run it. Guess right about which sandbox comes next and the gap disappears before the request arrives. Guess wrong and you've burned memory preallocating something nobody uses.
The claims come from a single abstract-level source with no independent benchmark. The workload mix behind the numbers, the prediction accuracy, and what happens on a miss aren't detailed here.
Each link below shares sources, entities, or timing with this story.
Shared entity: Infrastructure / Shared topic / Earlier coverage / Tension
Both cover Infrastructure; overlapping topics (agent, call, cost); earlier Infrastructure coverage from 2026-07-28.
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (agent, call, latency); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (agent, anyone, call); pushes against this story (against).
Same source domain / Shared topic
Reported by the same outlet (arxiv.org); overlapping topics (agent, anyone, cost, cuts).
Shared entity: Infrastructure / Same source domain / Earlier coverage
Both cover Infrastructure; reported by the same outlet (arxiv.org); earlier Infrastructure coverage from 2026-03-03.
Shared entity: Infrastructure / Shared topic / Earlier coverage
Both cover Infrastructure; overlapping topics (agent, anyone); earlier Infrastructure coverage from 2026-02-21.
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (abstract level, agent); pushes against this story (against).
Reported by the same outlet (arxiv.org); overlapping topics (agent, cost); pushes against this story (but).