Fetching from the wire…
Infra2026-08-02 · source-backed
Bruno Perez's post-mortem explains why they shipped a four-tier router in March and shut it down in June. Two arguments carry it: the prompt is only the trigger, since real task complexity emerges through tool calls after routing has already committed; and cache reads run 75-90% cheaper than uncached input, so the model stickiness that makes caching pay defeats the router's entire premise. Quality also degraded when models switched mid-workflow. No hard before/after cost numbers, which is the main thing to hold against it. Pick models deliberately per task instead of automating the choice.
Each link below shares sources, entities, or timing with this story.
LLM uses OpenAI / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; overlapping topics (already, cost, model, task).
LLM uses OpenAI / Shared entity: March / Shared topic / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover March; overlapping topics (already, call, committed, cost).
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (argument, model).
LLM uses OpenAI / Shared entity: LLM / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; overlapping topics (cost, model).
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (cost, model, task).
LLM uses OpenAI / Shared entity: LLM / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; overlapping topics (against, model).
LLM uses OpenAI / Shared entity: March / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (LLM uses OpenAI); both cover March; overlapping topics (cost, model).
LLM uses OpenAI / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (LLM uses OpenAI); both cover LLM; overlapping topics (caching, call).