Vibe Coding
Unsloth Updates All Gemma-4 GGUF Uploads with Corrected Chat Template and Inference Fixes
Unsloth published updated GGUF quants for all Gemma 4 models (26B-A4B, E4B, 31B, E2B variants) incorporating the corrected chat template with explicit `<|think|>` thinking control and llama.cpp compatibility fixes from April 8. Also fixed: grad accumulation exploding losses (300–400 → 10–15) and an IndexError affecting 26B/31B inference. If you downloaded Gemma 4 GGUFs before April 10, re-download for proper chat behavior.
Source
↳ Follow the thread