Fetching from the wire…
Public story · 2026-08-10 · high
GPT-5.4-mini's attack success rate jumps from 41.7% to 72.9% when the same goal is split across three pages, per Borealis AI's StepJack benchmark.
Why now: The paper posted to arXiv in August 2026, with its dataset and code released for anyone testing an agent against page-hopping attacks.
Splitting an instruction across three pages hijacks computer-use agents more often, per Borealis AI's StepJack benchmark. Average attack success across models climbs from 31.3% at one page to 36.9% across three, and GPT-5.4-mini alone jumps from 41.7% to 72.9%. For anyone shipping an agent that clicks or browses on a user's behalf, that's the gap between a nuisance and a drained wallet or inbox.
The perverse part: EvoCUA-32B held up best in testing, not because it's more secure, but because it struggles to follow multi-hop reference chains. It can't reliably connect an instruction spread across pages, so it misses the attack along with the task it was supposed to do. Every other model tested got more exploitable as it got better at stitching multi-step context together.
StepJack runs 480 examples that break a malicious goal into steps placed along an agent's navigation path, instead of dropping it in one obvious block. Borealis AI has published the dataset and code alongside the paper.
The models best at multi-step reasoning are the same ones easiest to hijack this way, and that won't fix itself as reasoning gets better. It gets fixed, if it does, by an agent checking where an instruction actually came from before it acts. StepJack's numbers suggest nobody's shipping that check yet.
Each link below shares sources, entities, or timing with this story.
Microsoft Research dropped a paper that should change how every builder thinks about their agent configuration files. SkillOpt (arXiv 2605.23904) treats a Markdown document as an external parameter of a frozen LLM and applies learning rate, batch, and momentum concepts in text...
If you have a CLAUDE.md, you're in scope. Today. arXiv 2607.14611 (cs.CR, filed July 16) evaluates prompt injection planted in the persistent memory files that agentic coding systems write and re-read across sessions. The researchers tested both Anthropic's Claude Code and Ope...
arXiv 2608.05108 skips the RL-trained attacker models that dominate red teaming and generalize poorly, instead accumulating a strategy library across a sequence of (dataset, target) pairs that transfers to unseen targets with no retraining. AgentDojo: 86.7% ASR against Gemini-...
The first systematic study of deceptive UI impact on LLM web agents, accepted at IEEE S&P 2026, tested against real e-commerce, streaming, and news dark patterns. Gemini 2.5 Pro: 65.78% susceptibility. Claude 3.7 Sonnet: 53.79%. GPT-4o: 51.26%. Guardrail models and prompt post...
Terminal-Bench 2.1 results (entries dated June 17) put Codex CLI on GPT-5.5 first at 83.4%, Claude Code on Fable 5 second at 83.1%, and Claude Code on Opus 4.8 at 78.9%. The asterisk matters more than the ranking: Fable 5 and Mythos 5 have been export-suspended since June 12,...
An automated framework evaluated GPT, Gemini, Claude and Grok on 85 algorithmic C# tasks derived from HumanEval, producing 340 solutions scored on three independent axes: functional correctness via unit tests, static quality via Roslyn AST analysis, and runtime efficiency via...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.