Fetching from the wire…
Public story · 2026-09-02 · high
Kaitchup's own tests are the only source so far, and the underlying per-quant numbers sit behind a paywall.
Why now: As of September 2, this is the only published quant comparison for the 27B model down to Q1.
A GGUF benchmark found Qwen3.8 27B holds full accuracy at 12.8GB in the Unsloth Dynamic Q3_K_XL quant, testing everything from Q4 to Q1, per Kaitchup's benchmark. That fits under the 16GB ceiling most consumer cards top out at, so the full 27B model no longer forces a drop to a smaller checkpoint.
The comparison runs the full quant range down to Q1, where accuracy usually falls off first. Kaitchup hasn't published the per-quant numbers outside a paywall, so the 100% accuracy claim at Q3_K_XL is single-source. Nobody outside that one benchmark has confirmed it yet.
On r/LocalLLaMA, an owner of a 3090 Ti says they're already running Q3_K_XL with mmproj and full context, using a q4 KV cache on max thinking mode. That's one person's setup, not a second benchmark, but it lines up with what Kaitchup reported.
If that 100% figure doesn't hold up once someone tests it independently, the 12.8GB number stops being a reference point and goes back to being one newsletter's read.
Each link below shares sources, entities, or timing with this story.
PR #21038 adds graph-level Hadamard rotation of Q/K/V before caching, doing attention in the rotated space then rotating back, which makes standard quant types far more accurate in the KV cache. The benchmarks are not subtle: Qwen3 0.6B q5_1 KV perplexity drops from ~61.7 to ~...
Alibaba released Qwen3.6-27B on April 22. Dense architecture. Open weights. 77.2% on SWE-bench Verified, within 3.7 points of Claude Opus 4.6. On SkillsBench, it scores 48.2% versus its own 397B MoE predecessor's 30.0%. That's a 77% improvement with 14.8x fewer parameters. Let...
SpeakoFlow Mini fine-tunes Qwen3.5-0.8B to apply only the corrections a speaker actually made and leave the rest alone. On the author's English-only benchmark it scored 70.7% against GPT-5.6 Luna's 65.0% under the same fixed short prompt with reasoning disabled, but the 95% in...
PR #19378 landed in llama.cpp this week, and I think most people are underselling what it means. Backend-agnostic tensor parallelism via --split-mode tensor makes multi-GPU inference work across AMD, Intel, and Apple Silicon. Not just CUDA. Everything. For context: llama.cpp h...
A month of solo work produced quants for LongCat-Flash-Lite-Sparse, Qwen3.8-27B, Qwen3.5-122B-A10B with MTPs, Qwen3-Coder-Next and Laguna-S2.1 with vision. Getting there meant writing Heretic support for the architecture from scratch and then adding llama.cpp support, and main...
v0.1.803-beta, released August 25 with 170+ PRs, lets long local chats continue past a model's context limit by rolling older turns into fresh context epochs rather than permanently trimming, with evicted conversations still searchable (GitHub). It also fixes MLX and Mac runti...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.