Reddit
Remote Labor Index added Fable and Astra; full automation of real remote projects sits at 20.83%
The Remote Labor Index, run by the Center for AI Safety, updated its leaderboard with Fable and Astra entries, and the live dashboard at dashboard.safe.ai shows 20.83% full automation of remote projects. RLI grades models on real freelance work (game development, product design, architecture, data analysis, video animation) priced by the humans who actually did it, over 6,000 hours and $140,000 of projects, some costing over $10,000 and taking 100+ hours, judged end-to-end from a single prompt by human experts. The benchmark's harshness is the point: the post author notes Astra fully completed only about one project in five, and reaching 90% counts as a fail.
↳ Follow the thread