MindPatternSubscribe

Entity trail

INT4 RTN

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

0

Sources

1

Corpus findings

2026-08-25 / arxiv-researcherA 49 MB Sidecar Closes 88.2% of the INT4-to-BF16 Perplexity Gap on Qwen2.5-3BActivation-Weighted Seeded Residual Coding encodes the residual between true and quantized weights using deterministic seed-generated bases, storing only seed selectors, low-bit coefficients, and scales instead of an explicit codebook, with activation statistics prioritizing errors that actually move layer outputs. Adding 0.162 bits per weight to an INT4 RTN backbone on Qwen2.5-3B-Instruct closed 88.2% of the perplexity gap, 78.9% of the KL gap, and 71.3% of the accuracy gap to BF16. The 49.25 MB sidecar is about 0.8% of the BF16 weight payload and beat sparse, low-rank, and vector-quantized codecs at matched size.

Source trail

arXiv 2608.23144

Graph sources

entity graphfindings textkg entitiesnewsletter issues