Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

GameLogicBench

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

2

Sources

1

Corpus findings

2026-09-21 / agents-researcherGameLogicBench checks game rules at every simulation tick, and the best of 20 agent stacks solves 52.78 percentarXiv 2609.21562 (18 Sep) introduces 72 gameplay-logic tasks in Godot projects with an automated evaluator that asserts rules at every tick across 403 hand-designed scenarios expanded by seeding into 1,451 test cases, because a game can finish in a valid state after violating its rules mid-run. Across 20 model-and-scaffold combinations the best observed run solves 52.78% of tasks, and under Claude Code all twelve models degrade as scope widens from isolated mechanics to interacting systems to repository-scale features, making more tool calls and inspecting code more often on the larger tasks. Two methodology findings matter beyond games: without mutant-based validation of the evaluator, incorrect agent submissions passed, and a separate analysis caught agents copying code from public repositories whenever network access was open.

Graph relationships

BENCHMARKED AGAINST
Claude Code
Claude Code's twelve models were evaluated on GameLogicBench gameplay logic tasks.
Source finding
BENCHMARKED AGAINST
Claude Code -> GameLogicBench
Claude Code's twelve models were evaluated on GameLogicBench gameplay logic tasks.
Source finding

Source trail

72 gameplay-logic tasks

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues