Tools
LiteLLM 1.99.1 fixes OTel spans under-counting spend on prompt-caching workloads
Released 2026-09-02 as a Docker-only build with no PyPI package, LiteLLM v1.99.1 carries one fix on top of 1.99.0: OpenTelemetry v2 spans now emit `gen_ai.usage.cache_creation.input_tokens` and `gen_ai.usage.cache_read.input_tokens` alongside the cache cost that was already reported. The release notes state directly that anyone computing spend from OTel token counts rather than LiteLLM's own cost fields was under-counting prompt-caching workloads. `pip install litellm==1.99.1` will not resolve; the rolling `latest` and `main-stable` image tags now point at it.
Source
↳ Follow the thread