Fetching from the wire…
01
02
03
04
05
06
07
08
Infra2026-08-25 · source-backed
Activation-Weighted Seeded Residual Coding encodes the residual between true and quantized weights using deterministic seed-generated bases, storing seed selectors, low-bit coefficients and scales instead of an explicit codebook, with activation statistics prioritizing the errors that move layer outputs (arXiv 2608.23144). Adding 0.162 bits per weight to an INT4 RTN backbone closed 88.2% of the perplexity gap, 78.9% of the KL gap and 71.3% of the accuracy gap to BF16. The sidecar is 0.8% of the BF16 weight payload and beat sparse, low-rank and vector-quantized codecs at matched size.
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source domain / Earlier coverage / Tension
Both cover BF16, Qwen2; reported by the same outlet (arxiv.org); earlier BF16 coverage from 2026-07-31.
Shared entity: Adding / Same source domain / Shared topic / Earlier coverage
Both cover Adding; reported by the same outlet (arxiv.org); overlapping topics (accuracy, adding).
Both cover Adding; reported by the same outlet (arxiv.org); overlapping topics (adding, beat).
Shared entity: Qwen2 / Same source domain / Shared topic / Earlier coverage
Both cover Qwen2; reported by the same outlet (arxiv.org); overlapping topics (accuracy, beat).
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (accuracy, between, bits, clos); pushes against this story (vs).
Shared entity: Adding / Same source domain / Earlier coverage / Tension
Both cover Adding; reported by the same outlet (arxiv.org); earlier Adding coverage from 2026-08-08.
Shared entity: BF16 / Shared topic / Earlier coverage / Tension
Both cover BF16; overlapping topics (accuracy, bf16); earlier BF16 coverage from 2026-05-10.
Shared entity: Adding / Same source domain / Earlier coverage / Tension
Both cover Adding; reported by the same outlet (arxiv.org); earlier Adding coverage from 2026-03-22.