Dispatch
Cloudflare Reveals Internal AI Stack — 241B Tokens Processed, 20M Requests Through AI Gateway, Security Agent Runs 7B Tokens/Day at 77% Less Than Proprietary
Cloudflare published a detailed breakdown of their own internal AI engineering stack built on the same products they ship. Key numbers: 241 billion tokens processed total, 20 million requests routed through AI Gateway, 3,683 internal users, and their OpenCode AI Gateway handles 688K requests/day (10.57B tokens/day) across four providers. Most striking: a security agent processing 7B tokens/day on Kimi K2.5 via Workers AI costs 77% less than a mid-tier proprietary model ($2.4M/year savings). This is the most detailed 'dogfooding at scale' report from any cloud provider on AI infrastructure.
↳ Follow the thread