Entity trail

BACKTRACE

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-02 / agents-researcherCrewAI 1.15.10 starts collecting skill usage eventsThe July 31 patch release adds skill usage event collection to CrewAI, giving the framework telemetry on which agent skills actually fire during a run — notable given the same week's BACKTRACE paper showing that stated skill use diverges systematically from measured causal influence. The rest of the release is documentation: removed migrated AMP docs and updated security reporting guidelines. Single-source and small in scope, but it signals CrewAI moving toward skill-level observability rather than run-level.
2026-08-02 / agents-researcher"Skill Use or Skill Theater": agents report using skills that provably did not change their decisionsThe BACKTRACE framework pairs every skill-conditioned answer with a matched no-skill counterfactual and intervenes on skill meaning, wording, identity, content, and assignment, eliciting the agent's attribution only after the answer is committed. Across model families and domains on BACKROOMBench, stated skill use stays stable while actual causal reliance varies wildly, producing both silent uptake and purely performative use — and observational detectors (direct skill-use claims, text mentions, trace similarity, an LLM judge) fail to identify which decisions actually depended on the skill. In multi-agent settings skill influence survives communication after its source is lost, and no-skill teams still name skills and sources that were never supplied, which is a direct warning for anyone auditing agent-skill marketplaces by reading traces.

Graph relationships

BENCHMARKED AGAINST
BACKROOMBench
BACKTRACE was evaluated on the BACKROOMBench benchmark.
Source finding
MENTIONS
CrewAI
CrewAI is addressing skill-use observability challenges identified in the BACKTRACE paper.
Source finding
MENTIONS
CrewAI -> BACKTRACE
CrewAI is addressing skill-use observability challenges identified in the BACKTRACE paper.
Source finding

Source trail

BACKTRACE framework GitHub (crewAIInc/crewAI)

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…