arXiv: LinuxArena — First Benchmark for AI Agents Operating in Live Production Software Environments

arXiv·medium signal

LinuxArena (2604.15384, April 16) is a control setting where AI agents operate directly on live, multi-service production environments rather than sandboxed simulations. Contains 20 environments and 1,671 real software engineering tasks where agents face actual consequences — crashed services, corrupted state, cascading failures. First benchmark to test whether agents can handle the messiness of production systems, not just solve problems in clean isolation.