Fetching from the wire…
01
02
03
04
05
06
07
08
Skills2026-08-03 · source-backed
A single-line guardrail cuts attack success by ~40 points in single-turn tests and gives back ~20 under four-turn escalation, with erosion patterns differing by model. If your red-team suite is single-turn, your robustness number is systematically inflated. Build four-turn chains for your top five risk scenarios this week.
Each link below shares sources, entities, or timing with this story.
arXiv 2607.29199 tests three frontier GUI agents under screen-grounded, user-side persuasion, with no environment injection at all. A single-line guardrail cuts attack success rate by ~40 points in single-turn scenarios. Four-turn escalation chains push guarded ASR back up by...
SpecPath found 35 of 100 passing implementations broke when only the revision path changed, with aggregate accuracy looking identical across paths. Build your eval set from real multi-turn clarification threads with amendments and reversals. Path sensitivity is invisible to st...
SARC-DQ found competent agents converted freshness/lineage/provenance defects into costly actions about 60% of the time, with both data-quality flags and the agents' own hedging detecting them at chance. The conversion rate was flat across four model tiers spanning a 15x price...
The PlayCoder benchmark is the cold shower the vibe coding movement needed. Researchers tested 10 state-of-the-art code LLMs on generating GUI applications across six categories. The models achieved high compilation rates. The code built and ran. But when they measured whether...
SWE Refactor Bench covers 20 whole-repository stack migrations across four technical-debt categories, grading each run through a migration audit, behavioral tests, and an independent verification agent (arXiv 2608.23564). Only 28 of 520 runs clear all three. Thirteen of the 20...
The Fortran-to-GPU port caught 5 of 162 numerically wrong kernels only because validation ran inside the loop (arXiv). Design for a 3% silent failure rate, because silent failures do not announce themselves at the end.
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.