Product Hunt's #1 Today Is a Tool That Audits Your LLM Provider's Invoice — Inferock Bench Issues an Independent Receipt for Every API Call
Inferock Bench took the top slot on Product Hunt's August 15 leaderboard with 154 upvotes: a local open-source proxy (FSL-1.1-Apache-2.0, converting to Apache-2.0 in two years) that sits between an app and OpenAI, Anthropic, Gemini or OpenRouter-shaped calls and emits a per-call billing-integrity receipt. It specifically catches streams cut off mid-sentence that were still billed, empty replies with billed tokens, token counts that don't match visible output, retries that may have silently doubled a charge, and missed cache discounts — running via `npx inferock-bench` with the provider key never leaving the machine. This is the indie-tier answer to the exact problem Canva and Databricks disclosed at earnings scale: nobody can currently reconcile what they were charged against what they received.
Source
↳ Follow the thread