SWE-CI Benchmark: AI Agents Fail at Long-Term Code Maintenance

arXiv·high signal

First benchmark on continuous integration loops. 100 tasks spanning avg 233 days. Most models achieve zero-regression rate below 0.25. Only Claude Opus exceeds 0.5.