Fetching from the wire…
01
02
03
04
05
06
07
08
Research2026-08-27 · source-backed
FrontierChallenge released 97 of 300 end-to-end scientific workflows across quantum chemistry, molecular dynamics, materials characterization, analytical chemistry, life science and electrochemistry, each specifying a bundle of required deliverables rather than a final answer (arXiv 2608.24979). Twelve frontier models across three scaffolds topped out at 20 of 97 tasks. Partial credit is actively misleading: analytical chemistry and electrochemistry scored 87.6 and 94.9 average with pass rates of 4% and 0%. The 75.5% false-completion rate is the number to hold onto, because it means an agent's own report of success carries close to no information at these difficulty levels.
Each link below shares sources, entities, or timing with this story.
Docker supports Claude Code / Shared entities / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Docker supports Claude Code); both cover Best, Claude Code; reported by the same outlet (arxiv.org).
Claude Code uses Opus / Shared entity: Claude Code / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Claude Code uses Opus); both cover Claude Code; reported by the same outlet (arxiv.org).
Claude Code uses MCP / Shared entity: Best / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Claude Code uses MCP); both cover Best; reported by the same outlet (arxiv.org).
Codex competes with Claude Code / Shared entity: Claude Code / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code; reported by the same outlet (arxiv.org).
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code; reported by the same outlet (arxiv.org).
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code; reported by the same outlet (arxiv.org).
Claude Code uses Opus / Shared entity: Best / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Claude Code uses Opus); both cover Best; reported by the same outlet (arxiv.org).
Microsoft criticizes Claude Code / Shared entity: Claude Code / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Microsoft criticizes Claude Code); both cover Claude Code; reported by the same outlet (arxiv.org).