Fetching from the wire…
Research2026-07-28 · source-backed
Epoch and METR's new benchmark asks models to re-implement real software from scratch using only CLI access to the original binary's I/O behavior. Across 25 target programs (22 released publicly) spanning six languages and 16k-61k lines, 17/25 hit perfect scores and 21/25 reached 99%+ accuracy, including Apple's pkl configuration language. Hardest holdouts: ruff, giac_subset, mailauth. The cost curve is the story, not the ceiling. gotree was reproduced for $100-400. "Rewrite this dependency instead of vendoring it" moves from a quarter of engineering to a line item you approve. (Import AI 466)
Each link below shares sources, entities, or timing with this story.
Anthropic partners with Apple / Shared entity: Import AI / Same source / Earlier coverage / Tension
Linked by a graph relationship (Anthropic partners with Apple); both cover Import AI; cite the same source (Import AI 466).
Apple supports Claude / Shared entity: Import AI / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Apple supports Claude); both cover Import AI; reported by the same outlet (importai.substack.com).
Apple partners with Google / Shared entity: Apple / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Apple partners with Google); both cover Apple; overlapping topics (apple, cost).
Jack Clark works at Import AI / Shared entity: Import AI / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Jack Clark works at Import AI); both cover Import AI; reported by the same outlet (importai.substack.com).
Apple released Siri AI / Shared entity: Apple / Shared topic / Earlier coverage
Linked by a graph relationship (Apple released Siri AI); both cover Apple; overlapping topics (access, apple).
Apple partners with Google / Shared entity: Apple / Shared topic / Earlier coverage
Linked by a graph relationship (Apple partners with Google); both cover Apple; overlapping topics (apple, dependency).
Anthropic partners with Apple / Shared entity: CLI / Shared topic / Earlier coverage
Linked by a graph relationship (Anthropic partners with Apple); both cover CLI; overlapping topics (benchmark, cost).
Anthropic partners with Apple / Shared entity: Import AI / Same source domain / Earlier coverage
Linked by a graph relationship (Anthropic partners with Apple); both cover Import AI; reported by the same outlet (importai.substack.com).