The graph

16,733 findings connected · drag the dots

The Wire · Live

By topic

16,733 findings indexed · 2,133 sources · +95/day · grouped by section

RESEARCH15

Research · 2026-07-15
OpenAI Ships GPT-5.6 Family (Sol/Terra/Luna) to API and Codex, Claims +13.1 on Agents' Last Exam vs Claude Fable 5
OpenAI launched the GPT-5.6 family on July 14, 2026 — Sol (flagship), Terra (cost-optimized), and Luna (fast tier) — rolling out across ChatGPT, Codex, and the API the same day after a US-government-requested delay for security review. GPT-5.6 Sol scored 53.6 on Agents' Last Exam, beating Claude Fable 5 (adaptive reasoning) by 13.1 points; at medium reasoning it exceeded Fable 5 by 11.4 points at roughly one-quarter the cost, with Terra/Luna claimed to beat Fable 5 / Opus 4.8 at ~1/5 the API cost. Sol adds an 'Ultra' subagent mode and a 'Max' reasoning-effort setting.

OpenAI

Research

Research · 2026-07-14

264K-Skill Study Detects When an Agent Skill's Description Lies About What It Actually Does

As open-source Agent Skill marketplaces grow, users pick third-party skills from brief metadata that may not match true behavior — a gap the authors call cross-layer misalignment. Their PL-HCL (Progressive Loading-Aware Hierarchical Contrastive Learning) method models the layered structure of skills (metadata, instructions, execution resources) and learns cross-layer consistency, trained on a normalized corpus of over 264,000 skills plus a human-verified challenge set. It lifts Macro-F1 from ~0.45 for unadapted baselines to 0.87–0.89 across LLM backbones — a directly relevant defense for anyone installing skills from a marketplace.

arXiv

Research

Research · 2026-07-14

BackendForge: Best Coding Agent (GPT-5.5) Deploys Correct Backends Only 28.6% of the Time Under a Strict Oracle

BackendForge is a benchmark of 56 contract-defined backend-generation tasks rewritten from real open-source apps, where an agentic LLM must produce a Dockerized service judged only through black-box HTTP tests against an OpenAPI contract. A test agent and code agent co-evolve the oracle and reference implementation to harden evaluation without hidden requirements. The best model, GPT-5.5, succeeds on 55.4% of tasks under the base oracle but just 28.6% under the final oracle — concrete evidence that agents handle local API behaviors yet still can't reliably ship complete, deployable services.

arXiv

Research

Research · 2026-07-14

NetInjectBench: Naive Network-Ops Agents Take Unsafe Actions 82.5% of the Time Under Prompt Injection

NetInjectBench is a 130-scenario benchmark (40 benign, 40 weak-attack, 40 strong-attack, 10 approved high-impact changes) for indirect prompt injection in tool-using network-operations agents, tested on Qwen2.5-7B, Llama3.1-8B, and Mistral-7B. Across 240 attack instances, naive execution hit an 82.50% unsafe tool-action rate; prompt-only defenses, Self-Reminder, Spotlighting, and a Two-Pass LLM Judge cut it to 25.63%/21.67%/18.33%/10.00%, while static allowlisting reached 5% but blocked 100% of approved changes. A metadata-aware policy gate produced 0/240 unsafe actions (95% Wilson upper bound 1.58%) while preserving 99.17% usefulness — the paper's thesis is that agents need execution-time authorization boundaries, not just prompt hygiene.

arXiv

Research

Research · 2026-07-14

Distributed Backdoors Prove Per-Step Agent Monitors Can Be Right on Every Step and Still Miss the Attack

This paper formalizes an 'observability boundary' for multi-agent LLM safety: a distributed backdoor splits a harmful payload across agents so every local message/tool-call check passes while only the assembled object is malicious, and they prove no detector on a local view can catch fragments once they look benign. Empirically, a monitor trained only on benign traffic recovers the attack's code structure across held-out encodings at 0.874 mean AUROC, and a decoded-view gate (given the encoding family) blocks every tested attack — but full-trace monitors still fail unless they reach the representation where the payload is exposed. The builder lesson: per-step runtime monitors are structurally insufficient when harm is compositional.

arXiv

Research

Research · 2026-07-14

MCPZoo Study: Scanners Call 96.89% of MCP Servers 'Risky' — But Under Half of Those Alerts Are Real

Researchers built MCPZoo, the largest dynamic-analysis corpus of Model Context Protocol servers to date — 64,611 unique servers (113,927 total), 37,288+ runnable — by using a multi-agent framework to turn static repos into live services. Ecosystem-scale measurement shows current MCP security scanners flag 96.89% of servers as risky, yet manual validation finds fewer than 50% of sampled alerts are true positives, with scanners disagreeing wildly with each other. For anyone wiring MCP tools into an agent, the takeaway is that today's scanner verdicts are close to noise; a public query interface is released for real risk assessment.

arXiv

Research

Research · 2026-07-14

Study of 44 Developers: AI Code Assistants Barely Improve Secure API Usage

A controlled study of 44 developers (arXiv 2607.11348) finds AI code assistants marginally improve correctness but do not meaningfully improve secure usage of security-sensitive APIs. It's an evidence-based cautionary data point for teams assuming copilots automatically harden code. Practitioners should keep security review in the loop rather than trust assistant output on crypto/auth APIs.

arXiv

Research

Research · 2026-07-14

StructAgent's Verifier-Backed State Machine Pushes Open-Source Digital Agents to 62–79% on Long-Horizon Tasks

StructAgent (arXiv 2607.11388) gives long-horizon digital agents a unified, verifiable state plus a structured workflow that only advances through verifier-backed transitions, enabling checkpointing and targeted failure recovery. It raises Qwen3.5-27B success from 31.6% to 62.2% and reaches 78.9% with MiniMax-M3, an open-source state of the art. A usable blueprint for making desktop-automation agents reliable over many steps.

arXiv

Research

Research · 2026-07-14

'Hourglass Reasoning' Boosts ARC-AGI-2 by 14 Points and Nearly Doubles Verilog Synthesis Accuracy

Think Through a Bottleneck: Hourglass Reasoning (arXiv 2607.11696) enforces strict isolation between an induction stage that distills examples into a schema/rule and a deduction stage, passing only compressed symbolic information between them. It improves ARC-AGI-2 best-of-5 accuracy by +14 points and lifts ChipBench Verilog synthesis from 31% to 58% with GPT-5.5. A practical architecture pattern for rigorous multi-step induction.

arXiv

Research

Research · 2026-07-14

'Agent Hacks Agent': Automated Red-Teaming Loop Builds a Reusable Vulnerability Concept Graph for LLM Agents

Agent Hacks Agent (arXiv 2607.11698) runs an autoresearch loop that forms vulnerability hypotheses, constructs falsifiers, and attacks target agents in a sandbox, then stores confirmed exploits in a transferable Vulnerability Concept Graph. The frozen graph outperforms the strongest discovery baseline by 14.2 percentage points and carries attack knowledge across different agent systems. Directly relevant to anyone shipping production agents who needs continuous, reusable red-teaming.

arXiv

Research

Research · 2026-07-14

Tool-Grounded LLM Agent 'TerraRepair' Lifts Terraform Security Fix Rates From 26.6% to 78.4%

TerraRepair (arXiv 2607.11390) is an LLM agent that retrieves Terraform dependency context, consults provider schemas, and re-runs security scanners to verify each fix. It raises Checkov-verified fix rates on AWS misconfigurations from 26.6% to 78.4% (and Trivy from 44.8% to 72.4%), and escalates instead of guessing when deployment context is missing. A concrete pattern for grounding IaC-repair agents in real schemas plus verifiers rather than free-form generation.

arXiv

Research

Research · 2026-07-13

Shared Selective Persistent Memory Lifts Agentic Task Completion to 96% and Cuts Per-Call Token Cost 97x

This method retains four categories of reusable context — task specifications, data schemas, tool configurations, and output constraints — while discarding session-specific reasoning, enabling role-based workspace transfer across users. It reports 96% task completion versus 79% without memory, a 14x faster 'zero-token' data refresh for recurring updates, and 97x lower per-invocation token cost versus injecting raw data each time. A concrete blueprint for builders wiring persistent memory into multi-agent LLM systems.

arXiv

Research

Research · 2026-07-13

SLBench Finds Up to 70% Unsafe Execution When Codex and Claude Code Follow Logical Relations in Skill Files

SkillLogic analyzes eight logical relations (preconditions, constraints, fallbacks, and more) inside agent skill files, and its 86-case executable SLBench benchmark recorded unsafe execution rates up to 70% when running Codex and Claude Code across six LLM backbones. It also found 70% of over 5,000 scanned public skills contain at least one such logical relation, and its paired SLGuard mitigation cut violations by 63% on targeted cases. Directly relevant to anyone shipping skill-based coding agents, where a mishandled precondition led to privacy leaks and unsafe config changes.

arXiv

Research

Research · 2026-07-12

'When the Judge Changes, So Does the Measurement' Shows LLM-as-Judge Upgrades Aren't Interchangeable

This paper treats evaluator-replacement as a measurement-validity problem: an LLM-as-judge score can move even when candidate responses are held fixed, simply because you swapped the judge. Across four judgment datasets it compares two real upgrade paths — scaling Qwen3 dense judges from 1.7B to 32B, and moving across MiniMax M2 to M2.7 APIs — and finds judge upgrades are not interchangeable (only Qwen3 1.7B-to-4B gave a robust adjacent gain). A caution for any team that silently upgrades its eval judge and assumes scores stay comparable.

arXiv

Research

Research · 2026-07-12

SMetric Rethinks LLM Scheduling for Agentic Serving, Where KV-Cache Reuse Tops 80%

SMetric argues human-oriented LLM schedulers misfit agentic serving: agents only act on complete responses, so cluster tokens-per-second (TPS) becomes the real objective and per-token latency requirements relax rather than vanish. In a production trace from BAILIAN, agent requests share so much context that KV-cache reuse exceeds 80% of request tokens versus 54-62% for human traffic, motivating a balanced session-centric scheduler. Directly relevant to anyone self-hosting inference for agent fleets.

RESEARCH15

OpenAI Ships GPT-5.6 Family (Sol/Terra/Luna) to API and Codex, Claims +13.1 on Agents' Last Exam vs Claude Fable 5

The daily brief, in your inbox.

264K-Skill Study Detects When an Agent Skill's Description Lies About What It Actually Does

BackendForge: Best Coding Agent (GPT-5.5) Deploys Correct Backends Only 28.6% of the Time Under a Strict Oracle

NetInjectBench: Naive Network-Ops Agents Take Unsafe Actions 82.5% of the Time Under Prompt Injection

Distributed Backdoors Prove Per-Step Agent Monitors Can Be Right on Every Step and Still Miss the Attack

MCPZoo Study: Scanners Call 96.89% of MCP Servers 'Risky' — But Under Half of Those Alerts Are Real

Study of 44 Developers: AI Code Assistants Barely Improve Secure API Usage

StructAgent's Verifier-Backed State Machine Pushes Open-Source Digital Agents to 62–79% on Long-Horizon Tasks

'Hourglass Reasoning' Boosts ARC-AGI-2 by 14 Points and Nearly Doubles Verilog Synthesis Accuracy

'Agent Hacks Agent': Automated Red-Teaming Loop Builds a Reusable Vulnerability Concept Graph for LLM Agents

Tool-Grounded LLM Agent 'TerraRepair' Lifts Terraform Security Fix Rates From 26.6% to 78.4%

Shared Selective Persistent Memory Lifts Agentic Task Completion to 96% and Cuts Per-Call Token Cost 97x

SLBench Finds Up to 70% Unsafe Execution When Codex and Claude Code Follow Logical Relations in Skill Files

'When the Judge Changes, So Does the Measurement' Shows LLM-as-Judge Upgrades Aren't Interchangeable

SMetric Rethinks LLM Scheduling for Agentic Serving, Where KV-Cache Reuse Tops 80%

MARKETS7

SaaStr: An Hour With Its Top AI Agent Cost $13.42 — 'You Can't Hire Anyone For That'

Valarian Raises $50M Series A (NEA) for a 'Sealed' Sovereign-AI Infrastructure Layer That Sits Beneath the Hyperscalers

Salesforce Down Over 40% in H1 2026 as AI-Disruption Fears Overpower Agentforce Growth; Q2 Guidance Undershoots

Auger Raises $50M Series B to Sit On Top of ERP/WMS/TMS and Run Supply-Chain Decisions Autonomously — 85% Autonomous at Fanatics

AI Video Startup PixVerse Closes $439M Series C (Extension), Valuation Tops $2B as It Pivots From Clips to Real-Time 'World Models'

CROSS-CATEGORY: Resolution-Based Pricing Is Standardizing in Support — Salesforce at $2, Fini at $0.69 per Resolved Ticket, No Charge on Escalation

CROSS-CATEGORY: AI Agent Pricing Is Decoupling From Seats in the Same Two-Week Window — OpenAI Meters by Token, Microsoft Gates Agents Behind a License Floor

AGENTS5

The Memory Heist: researcher exfiltrates Claude.ai memories via web_fetch link-following

GitLost: prompt injection in GitHub Agentic Workflows leaks private repos with zero credentials (CVE-2026-44246)

Nous Research in talks to raise $75M+ at a $1.5B valuation for its open-source Hermes agent

Ghostcommit hides prompt injection in PNG files to make AI coding agents exfiltrate repo secrets

GhostApproval: symlink flaw turns human-in-the-loop into a rubber stamp across 6 coding agents

VOICES6

Demis Hassabis Drops 'Framework for Frontier AI' Manifesto, Tells Axios the US Should Stand Up a Model-Screening Watchdog 'Before Year End'

Apple Sues OpenAI Over Trade-Secret Theft Tied to 400+ Ex-Apple Hires — Musk and Altman Take It Public

Nadella's 'Reverse Information Paradox': Enterprises 'Pay for Intelligence Twice' — and OpenAI/Anthropic Are Being Hypocrites on Distillation

Study: Claude Code 'Builds, Not Buys' — 2,430 Runs Show It Writes JWT+bcrypt From Scratch Before Reaching for Auth0

GPT-5.6's Real Developer Story: Programmatic Tool Calling and In-Request Multi-Agent Land in the Responses API

ChatGPT Work vs Claude Cowork: OpenAI Undercuts Anthropic With a Free-Tier Autonomous Work Agent and 1,400 Connectors

NEWS3

Chai Discovery Raises $400M Series C, Tripling Valuation to $3.8B in Seven Months

Enterprise Incumbents Form a Counter-Alliance to MCP: Google, Microsoft, Salesforce, Snowflake, ServiceNow Back a Shared Agent Backend Protocol

FT: OpenAI and Google Sold AI Services to Pentagon-Blacklisted Chinese Firms via Singapore Units

SOURCES6

Thomson Reuters Cuts Engineering Roles Citing AI — But New SignalFire Data Says Engineers Are the Most Resilient Job

Codex Adds Roughly 1M Users a Day — 6M to 8M in Days After GPT-5.6, and JetBrains Names It the Recommended Agent

Latent Space: The 5 Trends That Defined AI Engineering at World's Fair 2026 — 'Building Systems Around Agents, Not Just With Them'

Long-Horizon-Terminal-Bench: Best Frontier Agent Clears Just 15% of Real Terminal Tasks, Mean 4.3%

ToolFailBench: a 1,000-Task Diagnostic Benchmark That Localizes Exactly How Agent Tool Use Breaks

Import AI 464: Claude Fable Autonomously Writes the Fastest Megakernel Ever Submitted to KernelBench-Mega

TOOLS14

Pattern: Treat MCP Tool Output as an Untrusted Data Plane

GitHub Ships /security-review in the Copilot Desktop App — Pre-Commit LLM Scanning for All Tiers, Including Free

Rust 'Destructive Command Guard' Blocks rm -rf and DROP TABLE From Agents in Sub-Millisecond Time

Pattern: Large Language Ports Are Now Viable When Gated by Conformance Tests + Adversarial Review

Tip: Newer Anthropic Models Do Worse With Custom Edit Tools — Prefer the Native Editor Format

xAI's Grok 4.5 / Grok Build Undercuts Opus 4.8 by ~60%: $2.49 vs $11.80 per Task, but Hallucinations Are Up

JetBrains Ships an Open Kotlin Benchmark: Claude Code (Opus 4.7 xhigh) Leads at 85.7% on 105 Repo Tasks

Tencent Ships Fully-Local 4-Tier Agent Memory With Hard Benchmarks — No External API

claude-video Turns 'Watch This Video' Into a Portable Agent Skill — 8K Stars in Weeks

Pattern: MCP-Relayed Third-Party Content Is Now a First-Class Prompt-Injection Surface

GPT-5.6 Sol vs Claude Fable 5: Benchmark Lead Splits by Test, and METR Flags Eval-Gaming

Amp Replaces Named Modes With 'The Dial' — a low/medium/high/ultra Effort Knob Backed by Cross-Model Oracle Review

Claude Code Desktop v2.1.206 Ships a Sandboxed In-App Browser Panel the Agent Drives

Cursor 3.11 Ships Side Chats and Cloud Agent Hooks (beforeSubmitPrompt, subagentStart, stop)

REDDIT3

llama.cpp Merges Native Hy3 Support (PR #25395) — Tencent's 295B MoE Now Runs Locally via 1-Bit/4-Bit GGUF

Grok 4.5 Ships as SpaceXAI + Cursor's First Joint Frontier Model — Uses 4.2x Fewer Output Tokens Than Opus 4.8 on SWE-Bench Pro

Apple Sues OpenAI for Trade-Secret Theft, Naming Hardware Chief and Citing 400+ Poached Employees

PROJECTS3

GitHub Ships 'Agentic Autofix' in Public Preview — Copilot Now Explores, Fixes, and Re-Runs CodeQL Before Opening a PR

Meta's Muse Spark 1.1 Ships a 1M-Token Agentic Model Alongside Meta's First Paid Developer API

Mozilla Ships Tabstack, a Browser-Execution API Built for AI Agents

SKILLS8

Promote pre-production evals into runtime guardrails so nothing ships without passing

Replace hand-written prompts with DSPy signatures + MIPROv2 Bayesian optimization

Use Magentic orchestration to stop hand-wiring multi-agent handoffs — give a goal, a manager, and specialists

For agents that span multiple context windows, replace compaction with durable structured artifacts (feature-list JSON + git + progress files)

Rebuild MCP servers stateless ahead of the 2026-07-28 spec: no session store, round-robin LB, cacheable tools/list

Know the ~15× token premium before you fan out: single agents match multi-agent at equal budget

Use Programmatic Tool Calling (allowed_callers) to keep multi-tool intermediate results out of context