Anthropic Warns of Imminent Recursive Self-Improvement, Calls for an Industry 'Brake Pedal'

Anthropic·medium signal

Anthropic's Jack Clark and institute lead Marina Favaro published a warning (June 5) that 'full recursive self-improvement' — AI autonomously building its own successors — is closer than the industry assumed, and urged coordinated technical 'brake pedal' safeguards akin to Cold War arms control. Clark disclosed that ~80% of Anthropic's coding work is already done by Claude and could reach 100% within a couple of years. For practitioners, it reframes safety eval assumptions: current evaluations assume improvements happen only between training runs, which self-improving systems would break.