Chrome Puts an LLM in Your Browser. No API Key Required.

Zero server costs. Zero network latency. Zero privacy concerns. Full LLM inference, running in a browser tab.

Chrome 138+ now ships the Prompt API, a built-in JavaScript interface for running Gemini Nano entirely on-device. After a one-time 1.7GB model download, you get client-side access to six AI capabilities: Prompt (freeform generation), Summariser, Writer, Rewriter, Translator, and Proofreader. All processing happens locally. User data never leaves the device.

I've been watching on-device inference get closer for two years, but this is different. This isn't a research demo. It's a shipping browser API on the most popular browser in the world, supported on Windows 10+, macOS 13+, Linux, and Chromebook Plus. Android support is coming later in 2026.

For web developers, this opens a category of features that were previously impossible without server infrastructure. Form validation with natural language understanding. Client-side content moderation. Offline-capable writing assistance. Real-time translation without a network round-trip. Grammar checking that works on an airplane. Every one of these used to require an API key, a server, billing infrastructure, and a privacy policy. Now they require a few lines of JavaScript.

The 1.7GB download is the practical constraint. It's a one-time cost, but it's real, and you can't force users to trigger it. The model is Gemini Nano, which is capable but not Opus. You're not going to run complex multi-step reasoning or code generation with it. But for text transformation, summarization, and basic generation tasks, it's more than enough.

The Hacker News discussion (131 points, 79 comments) focused on whether this gives Chrome/Google too much control over what "AI in the browser" means. Fair concern. But from a builder perspective, I don't care who provides the API. I care that I can ship AI features to users without managing inference infrastructure. This is that.

If you build web apps, start experimenting with the Prompt API today. The Summariser and Rewriter APIs in particular have obvious product applications. Test on real users and see what the 1.7GB download barrier actually looks like in practice.