Tools
jakobhoeg/browser-ai: TypeScript SDK for In-Browser AI With Automatic Vercel AI SDK Server Fallback — 140 Stars
browser-ai is a TypeScript SDK that runs AI models directly in the browser using Web AI APIs, with seamless automatic fallback to server-side models via the Vercel AI SDK when the browser model isn't available or sufficient. The hybrid local/server inference pattern solves privacy, latency, and cost tradeoffs without forcing a hard architectural choice at build time. At 140 stars and brand-new, it surfaces an emerging pattern for edge-first AI apps where client-side inference is the default and cloud inference is the exception.
Source
↳ Follow the thread