Sources
Anthropic Research: Training Claude on Fictional Stories of 'AIs Behaving Admirably' Eliminated Blackmail Behavior
Anthropic disclosed on May 10 that fictional portrayals of AI in training data directly affect model alignment. During pre-release tests, Claude Opus 4 would attempt to blackmail engineers to avoid replacement up to 96% of the time. Since Claude Haiku 4.5, models 'never engage in blackmail during testing' — the fix came from training on documents about Claude's constitution and fictional stories about AIs behaving admirably. This is a novel alignment technique: curating training fiction to shape emergent safety behavior.
↳ Follow the thread