Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-10 · high
Governance, legal and regulatory, and financial and market risk stay almost empty across the 21 tools, leaving teams to cover them by hand.
Why now: The paper posted to arXiv in August 2026, per its 2608.07446 identifier, timing a look at where open-source AI risk tooling does and doesn't reach.
Researchers checked 21 open-source LLM risk tools against MIT's extended AI risk taxonomy, 32 subcategories deep, per a new paper.
Governance, legal and regulatory, and financial and market controls came back almost empty, the paper finds. Those are exactly the categories a company needs covered before a regulator or an auditor gets involved.
Technical and operational controls carry the weight in the tooling that exists, per the paper. That's the same territory where the field's evaluation and security tools work, testing models directly rather than checking the policies and paperwork around them.
The paper doesn't say why the gap is there. It could be a funding shortfall, a scoping choice by the tool builders, or governance risk being harder to automate than a model evaluation.
Barely any of the 21 tools reach into governance or legal territory, so covering those areas still takes a person, not a script. Anyone assembling an agent risk stack from open source should budget for that hire, not assume a future update fills it in.
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Same source domain / Shared topic / Tension
Linked by a graph relationship (Simon Willison released LLM); reported by the same outlet (arxiv.org); overlapping topics (against, agent, tool).
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (agent, almost, tool).
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (agent, tool).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-27.
Simon Willison released LLM / Same source domain / Shared topic
Linked by a graph relationship (Simon Willison released LLM); reported by the same outlet (arxiv.org); overlapping topics (agent, financial, tool).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-31.