Fetching from the wire…
01
02
03
04
05
06
07
08
Tools2026-08-02 · source-backed
Willison and Jesse Vincent's Prime Radiant shipped a compact eval framework on a four-layer model: an eval contains tasks, each task runs against configs (model plus parameters like system prompt), each execution produces a run, and graders apply checks; string matches, custom scripts, or model judges. Emits an interactive dashboard and a shareable static HTML report. The design point worth stealing is treating the harness as an independent axis, because in agentic systems the harness is frequently the actual bottleneck.
Each link below shares sources, entities, or timing with this story.
Simon Willison partners with Jesse Vincent / Shared entity: HTML / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison partners with Jesse Vincent); both cover HTML; reported by the same outlet (simonwillison.net).
Simon Willison partners with Jesse Vincent / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison partners with Jesse Vincent); both cover HTML, Willison; reported by the same outlet (simonwillison.net).
Willison uses DSPy / Shared entity: Willison / Same source domain / Earlier coverage
Linked by a graph relationship (Willison uses DSPy); both cover Willison; reported by the same outlet (simonwillison.net).
Simon Willison partners with Jesse Vincent / Shared entity: Willison / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison partners with Jesse Vincent); both cover Willison; reported by the same outlet (simonwillison.net).
Simon Willison partners with Jesse Vincent / Shared entity: Willison / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison partners with Jesse Vincent); both cover Willison; reported by the same outlet (simonwillison.net).
Prime Radiant released Superpowers
Linked by a graph relationship (Prime Radiant released Superpowers).
Linked by a graph relationship (Prime Radiant released Superpowers).
Linked by a graph relationship (Prime Radiant released Superpowers).