Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-21 · high
Agarwal, Chen and Qin's FlashRT has agents chain ASR, LLM, TTS and video models under one latency budget.
Why now: The FlashRT preprint is dated July 21, 2026, on arxiv.
Agarwal, Chen and Qin published FlashRT, a framework that has agents wire together ASR, LLM, TTS and video generation models into one real-time chain instead of running a single model.
The pitch: for voice agents and interactive video, the hard part was never any one model's output quality. It's that five models now share one latency ceiling, and a slow stage anywhere in the chain burns budget meant for every other stage, per the paper.
FlashRT treats the agent as the engineer who has to negotiate that budget across stages, not just as a wrapper that calls a model and waits. That's a different job description than most agent frameworks assume.
The paper doesn't say what latency numbers the framework hits in practice, or whether anyone's run it against a production voice stack. Without that, it reads as a framing contribution more than a benchmark win.
Still, the framing holds up without the numbers. Teams building voice or video agents tend to tune the LLM and call it done, while ASR and TTS quietly eat the rest of the latency budget. FlashRT's bet is that managing the interaction between stages matters more than optimizing any single one, and that's a claim worth testing against whatever benchmarks show up next.
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (code, even).
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (agent, code).
LLM uses OpenAI / Same source domain / Shared topic
Linked by a graph relationship (LLM uses OpenAI); reported by the same outlet (arxiv.org); overlapping topics (agent, code, model).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
LLM uses OpenAI / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; earlier LLM coverage from 2026-06-19.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-14.