Fetching from the wire…
Agents2026-06-19 · source-backed
A mid-June paper (arXiv:2606.16871) proposes scalable agent evaluation where humans oversee the few high-leverage decision points instead of reviewing every trajectory, shipping an open ProofAgent Harness for auditable evaluation. It targets the real bottleneck, evaluation not keeping pace with agent autonomy. This is the practical version of Karpathy's verifiability thesis. Route only the decisions where human judgment changes the outcome to a human, and automate provenance capture for the rest.
Each link below shares sources, entities, or timing with this story.
Shared entity: Human / Same source domain / Shared topic / Earlier coverage / Downstream implication
Both cover Human; reported by the same outlet (arxiv.org); overlapping topics (agent, human).
Shared entity: Human / Same source domain / Shared topic / Earlier coverage / Tension
Both cover Human; reported by the same outlet (arxiv.org); overlapping topics (chang, human).
Shared entity: Karpathy / Shared topic / Earlier coverage
Both cover Karpathy; overlapping topics (agent, automate, decision, human, karpathy); earlier Karpathy coverage from 2026-05-17.
Shared entities / Shared topic
Both cover Human, Karpathy; overlapping topics (agent, human, karpathy).
autoresearch built by Karpathy / Same source domain / Shared topic
Linked by a graph relationship (autoresearch built by Karpathy); reported by the same outlet (arxiv.org); overlapping topics (agent, harness).
Shared entity: Karpathy / Shared topic / Earlier coverage
Both cover Karpathy; overlapping topics (agent, bottleneck, human, karpathy); earlier Karpathy coverage from 2026-03-23.
Shared entity: Human / Shared topic / What happened next / Tension
Both cover Human; overlapping topics (agent, human); picks up the Human thread on 2026-08-04.
LLM Wiki built by Karpathy / Shared entity: Karpathy / Earlier coverage
Linked by a graph relationship (LLM Wiki built by Karpathy); both cover Karpathy; earlier Karpathy coverage from 2026-04-30.