DiG-bench Releases 70 Hidden-Rule Discovery Games — Every One Solved by a Human First Try, Only Opus 5 and Fable 5 Beat Any Tier-7 Task at 0.2 Success

arXiv / Import AI 469 (Jack Clark)·medium signalXBlueskyLinkedInCopy link

DiG-bench (arXiv 2608.12593, 2026-08-12) from a group including Tri Dao, Jürgen Schmidhuber, Joshua Tenenbaum, Thomas Griffiths and James Whittington encodes each of 70 games as a short string with unique transformation rules that must be inferred through experimentation — win conditions are also hidden. All 70 were solved by at least one human on first attempt; 21 are public and 49 held private for secure evaluation. Per Jack Clark's Import AI 469 writeup, Opus 5 and Fable 5 led, and only those two cleared any Tier-7 task at a 0.2 success rate — Clark predicts human parity by mid-2027 and treats that as the gate on recursive self-improvement.