Bonsai 1.7B: 290MB 1-Bit Model Runs Locally in Browser via WebGPU — 850 Upvotes on r/LocalLLaMA

Hugging Face·medium signal

PrismML's 1-bit Bonsai 1.7B model compresses to just 290MB using extreme 1-bit quantization and runs directly in Chrome via WebGPU with no server required. A Hugging Face Spaces demo lets anyone try it — the model maintains a 32K context window despite the compression. For builders: this is the first commercially viable path to shipping LLM features that run entirely client-side with zero infrastructure cost.