Hacker News
Experiential Is a Rust Model Gateway That Turns Your Own Production Traffic Into a Custom Router
This Show HN, at 196 points, is an open-source OpenAI-compatible gateway across closed, open-source, local and custom models, with per-user and per-agent controls over which models are allowed for which use cases and how much each can spend. The distinguishing claim is that logged production traffic is used to train a custom router or model tuned for quality, speed and cost, rather than routing on static rules. It is Rust-native, reports under 1 ms added latency for BYOK requests and under 2 ms when it supplies the provider key, and passes through your own OpenAI, Anthropic, Gemini, Azure, Bedrock, Fireworks or OpenRouter keys for free.
↳ Follow the thread