LiteLLM 1.100.0-rc.1 routes client housekeeping calls to the cheapest tier and splits cache savings by who earned them
GitHub·medium signal
The release candidate published 2026-08-30 adds a complexity_router rule sending client housekeeping calls to the cheapest model tier, and reports prompt caching savings as two numbers — total and gateway-attributed — so you can tell what the proxy saved you versus what the provider would have cached anyway. It also drops and self-heals empty thinking blocks on the Anthropic /v1/messages bridge and handles per-level reasoning_effort flags on models without supports_reasoning.