Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-02-28 · source-backed
"Towards a Science of AI Agent Reliability" (arXiv 2602.16666) — 12 concrete metrics decomposing reliability along consistency, robustness, predictability, and safety. Key finding: stronger performance on benchmarks does NOT correlate with reliable real-world operation. Interactive dashboard included. (arXiv)
"Black-Box Reliability Certification for AI Agents" (arXiv 2602.21368) — A single reliability number per system-task pair via self-consistency sampling and conformal calibration with distribution-free guarantees. Directly implementable deployment gate for production agents. (arXiv)
"Prompt Injection Attacks on Agentic Coding Assistants" (arXiv 2601.17548) — First SoK across 78 studies. Attack success rates exceed 85% against SOTA defenses. 42 distinct attack techniques cataloged. Architectural mitigations required — filtering is fundamentally insufficient. (arXiv)
SUSVIBES Benchmark (arXiv 2512.03262) — 200 real-world tasks. SWE-Agent with Claude 3.5 Sonnet: 61% functional correctness, only 10.5% secure. Adding security hints doesn't help. Security needs fundamentally different approaches, not better prompting. (arXiv)
Each link below shares sources, entities, or timing with this story.
Claude Code uses Sonnet / Shared entities / Same source domain / Shared topic / What happened next
Linked by a graph relationship (Claude Code uses Sonnet); both cover Adding, Agent, Claude, SWE; reported by the same outlet (arxiv.org).
Gemini competes with Claude / Shared entities / Same source domain / Shared topic / What happened next / Tension
Linked by a graph relationship (Gemini competes with Claude); both cover Claude, Sonnet; reported by the same outlet (arxiv.org).
Linked by a graph relationship (Gemini competes with Claude); both cover Claude, Sonnet; reported by the same outlet (arxiv.org).
Claude Code uses Sonnet / Shared entities / Same source domain / Shared topic / What happened next
Linked by a graph relationship (Claude Code uses Sonnet); both cover Adding, SWE; reported by the same outlet (arxiv.org).
Claude Code uses Sonnet / Shared entities / What happened next / Tension
Linked by a graph relationship (Claude Code uses Sonnet); both cover Agent, Claude, Sonnet; picks up the Agent thread on 2026-05-17.
Claude Code uses Sonnet / Shared entity: Sonnet / Same source domain / Shared topic / What happened next / Tension
Linked by a graph relationship (Claude Code uses Sonnet); both cover Sonnet; reported by the same outlet (arxiv.org).
Linked by a graph relationship (Claude Code uses Sonnet); both cover Sonnet; reported by the same outlet (arxiv.org).
Anthropic released Claude / Shared entities / Shared topic / What happened next / Tension
Linked by a graph relationship (Anthropic released Claude); both cover Claude, Sonnet; overlapping topics (against, attack).