Fetching from the wire…
Public story · 2026-09-02 · high
The fix only ships in Docker for now, so pip installs stay on the old span shape.
Why now: Released September 2, per LiteLLM's release notes.
LiteLLM released version 1.99.1 on September 2. It fixes a gap in how the proxy reports prompt-caching costs through OpenTelemetry. The release notes say OTel v2 spans now emit gen_ai.usage.cache_creation.input_tokens and gen_ai.usage.cache_read.input_tokens alongside the cache cost LiteLLM already reported. Those two fields split cache-building tokens from cache-read tokens, the pieces span data was missing before.
That's a spend-tracking bug, not a cosmetic one. If a cost dashboard sat on top of LiteLLM's OTel spans and derived dollar figures from raw token counts, it missed the cache tokens. Anyone who ran that math without checking LiteLLM's own cost fields was undercounting spend for as long as prompt caching was turned on.
There's a catch. The build is Docker-only, with no PyPI package alongside it. pip install litellm==1.99.1 won't resolve. Anyone running LiteLLM as a Python package instead of the container stays on the old span shape for now. The release notes don't give a date for when that might change.
Each link below shares sources, entities, or timing with this story.
Released September 1, leading its notes with cosign verification for ghcr.io/berriai/litellm, recommending verification against the public key at pinned commit 0112e53 because a commit hash is cryptographically immutable, with tag-based verification offered as the weaker optio...
An Apache-2.0 OpenAI-compatible gateway at 695 stars, with per-user and per-agent spend controls, that ingests OpenTelemetry traces from existing agent workflows, builds a simulation from them, and uses that to fine-tune an open-source model you own (GitHub). Rust-native, repo...
Hudson Rock got hold of the archive and counted it. 433,909 files. 118,829 CI runner dumps traced to 2,488 corporate domains. AWS keys, Salesforce client secrets, Slack signing secrets, Azure environment variables, and AI provider API keys belonging to NVIDIA, Volkswagen, Micr...
Google's Agent Development Kit for Python listed litellm>=1.75.5 as an optional dependency. No upper bound. No pin. During the week of March 24, LiteLLM versions 1.82.7 and 1.82.8 were compromised by the TeamPCP group with a three-stage payload: credential harvesting, Kubernet...
elie222/rakazo appeared Aug 13, Apache-2.0, TypeScript, explicitly bring-your-own model and sandbox (tested against Docker, E2B, Daytona) with the Pi runtime underneath and OpenRouter, Codex, Copilot, or SuperGrok device-code sign-in instead of a mandatory API key. Each bot ge...
- Source: GitHub (ykdojo/claude-code-tips) The most comprehensive single resource for power-user tips. Highlights: (1) proactive context compaction via HANDOFF.md documents; (2) Gemini CLI as fallback when WebFetch fails on blocked sites; (3) skills vs. CLAUDE.md optimization...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.