ngrok Launched an AI Gateway That Puts Self-Hosted Models Behind the Same Endpoint as OpenAI and Anthropic

ngrok (corroborated by Product Hunt August 5 leaderboard)·medium signalXBlueskyLinkedInCopy link

ngrok's AI Gateway hit Product Hunt on August 5 at #4 with 160 upvotes, offering one key and one URL that routes across public providers, custom endpoints, and models you run yourself, with observability, fallbacks, and per-app access control built in. The architecturally interesting piece is that private models connect through ngrok's existing tunnel network, so a self-hosted model sits beside hosted providers without ever being exposed to the public internet. Billing is optional ngrok credits or bring-your-own provider keys — the gateway is deliberately not trying to be the model vendor, which is the opposite of how incumbent AI features get bundled.