Fetching from the wire…
01
02
03
04
05
06
07
08
Models2026-06-25 · source-backed
A widely shared r/LocalLLaMA benchmark measured token-by-token KL divergence across ~250K tokens, varying only KV-cache precision on the same BF16 GGUF. Gemma 4 26B-A4B jumped to KL 0.377 at q8_0 and 1.088 at q4_0, while both Qwen 3.6 models stayed under 0.04 at q8_0 and were still usable at q4_0 (LocalBench). That's a ~9x difference in degradation between architectures at the same setting. If you run local models, stop treating KV-cache precision as a universal "lower until it hurts" dial. Test it per model, because the same q8_0 that's free on Qwen visibly hurts Gemma.
Each link below shares sources, entities, or timing with this story.
Qwen competes with Google / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Qwen competes with Google); both cover Gemma, LocalLLaMA, Qwen, Test; overlapping topics (benchmark, model).
Alibaba released Qwen / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Alibaba released Qwen); both cover Gemma, LocalLLaMA, Qwen; overlapping topics (benchmark, model, same).
Qwen competes with Google / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Qwen competes with Google); both cover Gemma, LocalLLaMA, Qwen; overlapping topics (benchmark, gemma, model, same).
Linked by a graph relationship (Qwen competes with Google); both cover Gemma, LocalLLaMA, Qwen; overlapping topics (gemma, model, qwen).
OpenCode uses Qwen / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (OpenCode uses Qwen); both cover Gemma, Qwen; overlapping topics (gemma, model, same).
Qwen competes with Google / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Qwen competes with Google); both cover Gemma, Qwen; overlapping topics (model, qwen).
Qwen competes with Meta / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Qwen competes with Meta); both cover Gemma, LocalLLaMA; overlapping topics (between, model).
Qwen competes with Google / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Qwen competes with Google); both cover LocalLLaMA, Qwen; overlapping topics (model, qwen).