Cloudflare: Half of All HTML Requests Are Already Non-Human, Tracking to Two-Thirds by Year-End
Cloudflare's Stephanie Cohen told SaaStr AI 2026 that 50% of HTML requests are already non-human and the figure is tracking toward 66% by year-end, and advised vendors to serve agents lightweight formats — Markdown is about 80% lighter than HTML — and to add cryptographic verification for bot-initiated transactions. Cloudflare's own crawl-to-referral data shows the economics behind it: OpenAI's crawler fetched roughly 1,700 pages per referral sent back and Anthropic's ratio ran to 73,000-to-1, which is why Cloudflare abandoned pay-per-crawl on July 1 in favor of paying publishers when their content appears in an answer, and will block mixed-use AI crawlers by default on ad-carrying pages starting September 15. For any SaaS company whose top-of-funnel is content, the marketing site is now primarily a machine-readable API with a failing referral business attached.
↳ Follow the thread