Dispatch
Import AI 457: AI Stuxnet Analogy, Muon Optimizer's Neuron Death Bug, and Aurora — A Better Alternative
Jack Clark's latest newsletter covers three major stories: (1) fast16.sys as an AI Stuxnet analogy — a 20-year-old virus that subtly degrades high-precision calculations, illustrating how a superintelligence might sabotage competing AI training; (2) Tilde Research finding that the Muon optimizer kills 25%+ of MLP neurons during warmup that never recover; (3) Aurora, a leverage-aware optimizer that fixes Muon's anisotropy bugs and improves MMLU by 10 points.
Source
↳ Follow the thread