A Contract-Grade Verifier Rejects 39.5% of Machine-Generated GPU Kernels That Standard Harnesses Accepted

arXiv / Hacker News·medium signalXBlueskyLinkedInCopy link

Rishi Shah and Rishav Shrestha submitted arXiv 2608.12700 on August 13, 2026, applying twelve adversarial correctness gates to 2,638 machine-generated GPU kernels that conventional test harnesses had already accepted. 39.5% show fundamental errors beyond any tolerance threshold and 62.1% violate at least one gate — meaning standard testing greenlit 1,487 kernels the verifier rejects. The paper also contributes what the authors call the first native Blackwell tcgen05 backward pass for the gated-linear-recurrence family, including the reverse-state stage competing systems still punt to fallbacks, validated against double-precision references.