Vibe Coding
ARC-AGI-3 Deep Analysis: GPT-5.5 Scores 0.43%, Opus 4.7 Scores 0.18% — Three Failure Modes Identified
ARC Prize published a detailed May 1 analysis of 160 replays from GPT-5.5 and Opus 4.7 on ARC-AGI-3's novel interactive environments, where humans score 100%. Three failure modes emerged: local observation without global comprehension, training data interference (mapping unfamiliar mechanics to known games like Tetris), and success without understanding (winning Level 1 while carrying misconceptions). Opus over-committed to confident-but-wrong theories; GPT-5.5 failed to compress observations into hypotheses at all.
Source
↳ Follow the thread