Sources
Simon Willison: datasette-llm-limits — Per-User LLM Spending Controls for Multi-Tenant Datasette Applications
Simon Willison released datasette-llm-limits 0.1a0, a plugin that enforces monetary spending caps on LLM API usage within Datasette instances. Works with datasette-llm (core LLM functionality) and datasette-llm-accountant (cost tracking) to provide granular control: per-user daily limits, rolling 24-hour windows, and maximum spend amounts in USD. Solves the 'unexpected LLM bill' problem for multi-tenant deployments.
↳ Follow the thread