Amodei and Altman at the UN: Amodei asks for a bioweapons ban and incident notification, Altman for capability benchmarks
The Security Council heard Amodei and Altman on September 23, the day after our item on Marcus objecting to the invitation. Amodei said that 'if managed poorly... AI could be a risk to humanity as a whole' and proposed three narrow deals: a global ban on AI-enabled bioweapons, verification systems so countries can check each other's commitments, and common testing standards with a notification system for AI security incidents. Altman said the moment 'calls for extreme care', argued against both 'blind optimism' and 'doomerism', and pitched benchmarks for measuring capabilities and safeguards. Two frontier-lab CEOs are now on the record asking for incident notification, which puts eval and trace logging for agent builders on the compliance track.
↳ Follow the thread