Fetching from the wire…
01
02
03
04
05
06
07
08
Agents2026-08-14 · source-backed
Vero (arXiv 2608.13522) is the first benchmark asking agents to produce implementation and machine-checked proof together across multi-module repositories, with 43 Lean 4 instances ported from real Python, Dafny, Verus and Coq projects. The strongest configuration with Lean toolchain access closed no specifications at all on the hardest repos. The failure is keeping implementation and proof choices coherent at repository scale, which is exactly the regime where "verified by an agent" would mean something.
Each link below shares sources, entities, or timing with this story.
OpenAI uses Lean / Shared entity: Python / Shared topic / Earlier coverage
Linked by a graph relationship (OpenAI uses Lean); both cover Python; overlapping topics (access, agent).
OpenAI uses Lean / Shared entity: Frontier / Shared topic / Earlier coverage
Linked by a graph relationship (OpenAI uses Lean); both cover Frontier; overlapping topics (access, asking).
OpenAI uses Lean / Same source domain / Shared topic / Tension
Linked by a graph relationship (OpenAI uses Lean); reported by the same outlet (arxiv.org); overlapping topics (access, agent).
Shared entities / Same source domain / Shared topic / Earlier coverage / Tension
Both cover Dafny, Lean, Verus; reported by the same outlet (arxiv.org); overlapping topics (benchmark, lean, verified).
OpenAI uses Lean / Shared entity: Frontier / Earlier coverage / Tension
Linked by a graph relationship (OpenAI uses Lean); both cover Frontier; earlier Frontier coverage from 2026-02-25.
OpenAI uses Lean / Shared topic / Tension
Linked by a graph relationship (OpenAI uses Lean); overlapping topics (agent, benchmark, coding); pushes against this story (against).
Linked by a graph relationship (OpenAI uses Lean); overlapping topics (benchmark, coding, hardest); pushes against this story (against).
OpenAI uses Lean / Shared entity: Lean / Earlier coverage
Linked by a graph relationship (OpenAI uses Lean); both cover Lean; earlier Lean coverage from 2026-08-02.