Fetching from the wire…
Agents2026-07-09 · source-backed
After GUI agents climbed from 12% to roughly 85% on the original OSWorld, the new 2.0 benchmark where the median task takes a human about 1.6 hours drops the best frontier system to 20.6%. This is the caution I keep repeating: a slick two-minute demo does not extrapolate to a two-hour workflow. The saturation of old benchmarks hid how far we are from reliable multi-hour autonomy.
Each link below shares sources, entities, or timing with this story.
Shared entity: OSWorld / Shared topic / Earlier coverage / Tension
Both cover OSWorld; overlapping topics (agent, climbed, task); earlier OSWorld coverage from 2026-04-21.
Shared entity: Best / Shared topic / Earlier coverage
Both cover Best; overlapping topics (agent, best, frontier, hour); earlier Best coverage from 2026-03-17.
Shared entity: OSWorld / Shared topic / Earlier coverage / Tension
Both cover OSWorld; overlapping topics (frontier, task); earlier OSWorld coverage from 2026-03-17.