Anthropic Proposes AI Safety Rules, Denies Banning Open Weights

Anthropic published a position paper on July 27 proposing mandatory pre-release safety testing for every "sufficiently capable" AI model, open or closed. Any lab whose model clears that bar has to prove it before shipping, and open-weights developers read that as regulation aimed at them.

The policy also calls for blocking powerful chips and chipmaking equipment from reaching China and cracking down on what it calls "industrial-scale distillation operations." Startups and academic labs are exempt from the testing requirement.

The post states flatly that Anthropic "has never advocated for a ban on open-weights models." r/LocalLLaMA didn't read it that way. Its thread was titled "Anthropic is calling for a ban on open-weights models by proposing mandatory requirements they will probably never be able to meet." The thread pulled 174 upvotes and 87 comments. Over on r/singularity, a neutrally titled version of the same story drew 237 comments against only 137 upvotes. That ratio usually means people are arguing more than agreeing.

Dario Amodei spent July 27 repeating the denial in interviews with CNBC, TechCrunch and Axios. None of that changes what the policy actually asks for. Any lab shipping a "sufficiently capable" model has to clear the same pre-release testing bar Anthropic sets for itself, exempt status or not.

That's the part worth watching. Startups and academia are carved out, but the labs actually releasing competitive open-weight models aren't, the kind r/LocalLLaMA builds its community around. A testing requirement scoped to "sufficiently capable" models can be worded as safety policy. It can still land as a de facto ban on the releases that matter, no matter how many times Amodei says otherwise.