DEFault++: Automated Fault Detection, Categorization, and Diagnosis for Transformer Architectures
arXiv·high signal
Presents an automated system for detecting and diagnosing faults in transformer model implementations — targeting attention mechanisms, projection layers, and normalization components. Unlike existing debugging tools that require manual inspection, DEFault++ categorizes faults taxonomically and provides root-cause diagnosis, directly useful for practitioners deploying production transformer models.