Fetching from the wire…
Public story · 2026-09-24 · high
Two safety monitors missed every forged request, letting 39.6% of would-be refusals complete as data exfiltration.
Why now: The token-forging paper posted to arXiv on September 23.
Forging gpt-oss-20b's own control tokens erases its reasoning, according to a paper posted to arXiv on September 23. A rule-based monitor and a separate cross-family LLM monitor each caught every plain unsafe request tested. Neither caught a single forged one, and the attack converted 39.6% of requests the model would otherwise refuse into completed data exfiltration.
The mechanism is a tokenizer quirk. One string of the model's own channel-control tokens, placed in a user message, reads to the tokenizer as a signal that the reasoning turn already finished. Chain-of-thought output drops from 52.5 tokens to zero and the model jumps straight to a tool call. That skip blinds any monitor built to scan reasoning text for red flags, because once the skip happens there's no reasoning text left to scan.
A second test in the same paper looked at the agent harness instead of the model. Two parsers built for a Gemma-based agent fired a truncated tool call on 24 of 24 trials. Run through a different parser, the identical model generations produced zero truncated calls. The model didn't change. The parsing code did.
Both findings land on the same gap. A safety check built to read a model's reasoning has nothing to read once a user forges the tokens marking reasoning as finished, and the code parsing a model's output carries as much risk as the model itself.
Each link below shares sources, entities, or timing with this story.
A training-free fix called ChannelGuard held steady across three model backends, filter or no filter, blocking every tool-poisoning attempt.
Escaped quotes and curly dollar signs planted in sender-name fields fooled six frontier models, beating purpose-built defenses half the time.
Missing argument logs hid why the agents failed for ten days across 8,199 runs testing 40 open and hosted models.
The paper's fix improved Auto Mode, but its authors admit blocking these multi-step attacks affordably is still unsolved.
The same gate did nothing for a smaller agent and lowered another model's score on a second benchmark.
Across 46 model endpoints, block rates on the same forged-command test swing up to 47 points between configurations.
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.