Crossflow makes prefill-decode disaggregation elastic for 16-17% more throughput.

Production fleet measurements show uncached-input-to-output ratios swinging up to 4.7x peak-to-mean at minute scale, and a public agentic trace showed a 24.5x median hourly range. Static P/D pools sized at p95 waste up to 17% of capacity. Decode nodes publish short-lived revocable leases for local prefill, giving 16.2-17.4% geomean throughput gains and up to 43.4% at high load, with lower mean TTFT at every point tested (arXiv).