Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-13 · high
Researchers scanned 5,000 public skill files, found 70% carry the same logic, and their filter cut violations 63%.
Why now: SkillLogic's numbers are dated July 13, as public skill marketplaces keep growing with no standard precondition check in place.
SkillLogic's SLBench benchmark clocked unsafe execution rates up to 70% across six LLM backbones, including Claude Code and Codex, per the SkillLogic paper. The tool checks skill files for eight logical relations, things like preconditions, constraints, and fallbacks. Then it runs 86 test cases to see whether the model actually honors them.
Anyone installing skills from the public ecosystem is exposed. The same researchers scanned more than 5,000 public skill files and found 70% contain at least one of these relations. In testing, a mishandled precondition led to privacy leaks and unsafe config changes, exactly the failure mode the benchmark is built to catch.
There's a partial fix. The team's own mitigation, SLGuard, cut violations by 63% when layered on top. That's real progress, but it still leaves over a third of the unsafe runs getting through. The paper doesn't say whether SLGuard scans skills already sitting in public registries or only catches new ones going forward. That's the detail I'd want before trusting the fix.
The failure rate isn't the real story here. It's that 70% of the skills already circulating carry this same unscanned logic. Most of the marketplaces distributing them have nothing like SLGuard checking files before they ship. I'd bet that number barely moves by the time the next wave of skill files lands. If you're pulling skills into Claude Code or Codex from a public registry, read the precondition logic yourself before you trust it.
Each link below shares sources, entities, or timing with this story.
Codex competes with Claude Code / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex, LLM; reported by the same outlet (arxiv.org).
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, LLM, Worse; reported by the same outlet (arxiv.org).
Codex competes with Claude Code / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex, LLM; overlapping topics (agent, claude, skill).
Codex competes with Claude Code / Shared entities / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex; reported by the same outlet (arxiv.org).
Codex competes with Claude Code / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex, LLM; overlapping topics (agent, claude).
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex, LLM; overlapping topics (agent, claude).
Codex competes with Claude Code / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex; overlapping topics (agent, benchmark, claude).
Linked by a graph relationship (Codex competes with Claude Code); both cover Claude Code, Codex; overlapping topics (agent, claude, skill).