ARC-AGI-3 Launches: Best AI Scores 12.58%, Frontier LLMs Under 1% — New Interactive Benchmark Tests Skill Acquisition
The ARC Prize Foundation launched ARC-AGI-3, the first interactive AI benchmark requiring agents to explore video-game-like environments with no stated rules or goals. Best AI preview score is 12.58% against a 100% human baseline; frontier LLMs like Gemini 3.1 Pro and Opus score under 1% despite spending thousands in test-time compute. The new RHAE (Relative Human Action Efficiency) scoring replaces static puzzle-solving with a measure of how efficiently agents learn compared to humans. Prize pool exceeds $2M across three tracks; all solutions must be open-sourced under MIT/CC0 with no internet access during evaluation. Reddit engagement is massive: 703 upvotes (r/singularity), 236 (r/LocalLLaMA), plus multiple analysis threads totaling 500+ comments.
↳ Follow the thread