UC Berkeley Researchers Break All 8 Top AI Agent Benchmarks Without Solving a Single Task

UC Berkeley RDI·high signal

Berkeley RDI built an automated scanning agent that achieved near-perfect scores on eight major AI agent benchmarks — SWE-bench Verified (100%), Terminal-Bench (100%), WebArena (~100%), FieldWorkArena (100%), GAIA (~98%), and OSWorld (73%) — using exploits like pytest hooks, binary wrapper trojans, and config leakage rather than actually solving tasks. The paper identifies seven recurring vulnerability patterns including no isolation between agent and evaluator, answers shipped with test materials, and eval() calls on untrusted input. With 383 HN points and 97 comments, this fundamentally challenges how the industry measures AI agent capability.