Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-26 · high
Matching a teacher model on the first token doesn't guarantee matches across a full response, per Heretic's author.
Why now: The post and the r/LocalLLaMA thread are both circulating as of August 26.
Multiverse Computing published a claim that a compressed 4-bit model beats its own full-precision original. Read closely, that's not what happened. The Quantization-Aware Healing post describes cutting a 120B model to 60B in BF16, then compressing that 60B model further to mxfp4. The mxfp4 version beats the 60B BF16 checkpoint. It doesn't beat the original 120B model.
That gap matters. "Compression beats the source" and "compression beats an already-shrunk checkpoint" are different claims. The first would change how people weigh precision against size in production. The second is a narrower result about healing a model after most of its parameters are gone.
r/LocalLLaMA caught the gap within hours of the post going up. The sharpest technical objection came from the author of Heretic, and it targeted the method itself. Multiverse uses KLD against the teacher model's output distribution as its loss function during healing. The Heretic author calls that reasonable, but argues first-token KLD poorly predicts how a model diverges across a full response. A model can match the teacher's first-token distribution and still drift over a full response.
Multiverse's post doesn't address that critique. If quantized models start getting pitched as upgrades over their full-size sources, this comparison is worth checking before you repeat it.
Each link below shares sources, entities, or timing with this story.
Shared entities / Shared topic / Earlier coverage / Tension
Both cover Aware Healing, Quantization; overlapping topics (against, beat, compressed, model); earlier Aware Healing coverage from 2026-08-24.
Meta criticizes Heretic / Shared entity: LocalLLaMA / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Meta criticizes Heretic); both cover LocalLLaMA; reported by the same outlet (huggingface.co).
Shared entities / Shared topic / Earlier coverage
Both cover BF16, LocalLLaMA; overlapping topics (against, bf16, model); earlier BF16 coverage from 2026-08-23.
Both cover KLD, LocalLLaMA; overlapping topics (apart, beat, different); earlier KLD coverage from 2026-08-04.
Meta criticizes Heretic / Shared entity: LocalLLaMA / Same source domain / Earlier coverage
Linked by a graph relationship (Meta criticizes Heretic); both cover LocalLLaMA; reported by the same outlet (huggingface.co).
Meta criticizes Heretic / Shared entity: Different / Shared topic / Earlier coverage
Linked by a graph relationship (Meta criticizes Heretic); both cover Different; overlapping topics (different, model).
Meta criticizes Heretic / Same source domain / Shared topic
Linked by a graph relationship (Meta criticizes Heretic); reported by the same outlet (huggingface.co); overlapping topics (against, base, model).
Shared entities / Shared topic / Earlier coverage
Both cover BF16, LocalLLaMA; overlapping topics (beat, bf16); earlier BF16 coverage from 2026-08-21.