The "fragile" Gated DeltaNet gates turn out to be the least quantization-sensitive part.

Community 4-bit quantizations of Qwen3.8-27B kept the 48 GDN layers' decay and write-strength gates at 8 or 16 bits, on the intuition that recurrence errors accumulate. Minima pushes NVFP4 W4A4 through all 496 linear layers including GDN and matches BF16 within seed noise across 4K/32K perplexity, MMLU-Pro, GSM8K, AIME'25, GPQA-Diamond, LiveCodeBench and RULER to 64K, 5-task average -0.52, smallest footprint at 17.5 GiB, 14-19% faster prefill. The gate projections compress roughly 11% GEMM error to about 2% output error, and the delta-rule recurrence holds injected noise flat over 32K tokens because each write overwrites state along the current key direction. arXiv 2609.04098