Fetching from the wire…
Public story · 2026-09-08 · high
Training models on the reasoning alone, without the refusal script, cut false refusals while safety stayed the same.
Why now: The paper posted to arXiv in September, and the fix needs no retraining to test.
A paper splits AI safety training into a refusal line and the reasoning behind it, then isolates which piece causes false refusals, per arXiv 2609.04714.
The refusal statement breaks a model's ability to tell harmful queries from benign ones that just use superficially risky wording. The rationale alone doesn't.
That's why a model trained on the refusal line can't tell a question about shooting a photo from one about shooting a person. A builder running that model ends up debugging a false refusal with no clue in the prompt.
Training on the rationale alone, with the boilerplate refusal line stripped out, cut false refusals while keeping safety about the same. The same reduction showed up when researchers left the model's weights untouched and put the rationale in the prompt instead, an in-context-learning setup. That means a team can test the fix by editing a prompt, not by retraining a model.
Each link below shares sources, entities, or timing with this story.
Existing neuron-level defenses stay always-on and perturb every benign request (arXiv 2608.14392). Tripwire identifies safety-specific neurons through per-neuron hypothesis tests under false-discovery-rate control plus a utility-specificity filter, then clamps them to harmful-...
Li, Huo, and Johnson show that one-way message flow between agents produces neither mimicry nor solo behavior but an entirely novel dynamical state, at identical temperature settings. It's conceptual rather than quantitative, but the implication for orchestrator-worker fan-out...
The standard protocol ablates a latent and measures effect at the token where it fires hardest, but that token is chosen by the dictionary under evaluation. Two dictionaries get compared at different places. Training six autoencoders from one initialization showed 7.6% and 11....
arXiv 2608.12253 shows the standard practice of training a policy against a single LLM simulating the user fails because the simulator is itself mode-collapsed, so the policy learns to exploit its dominant mode. Verbalized Sampling recovers up to 9% held-out success; Populatio...
RETRACE has a verifier infer what problem the patch appears to solve using only the patch and trajectory, then compares that inference against the real issue. Training-free, lifted Pass@1 by 7.0% and 3.6% on mini-SWE-agent over SWE-bench Verified. The information-hiding trick...
The diagnosis in this paper is better than the fix, and the fix is very good. Recurrent memory agents fail at long context, but not for the reason most people assume. The bottleneck isn't capture. It's retention. Retention falls below 30% at 896K tokens because every consolida...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.