Fetching from the wire…
Vibe Coding2026-08-11 · source-backed
OpenCodeReview (arXiv 2608.09290) argues LLM reviewers fail on non-determinism from unbounded tool use and on context locality that caps issue depth at the diff. Its fix injects structure at three points: a multi-layer rule system deterministically selects which files get reviewed against which criteria, per-file review runs on a curated toolset, and an Independent Reflection stage applies a falsification-first filter to strip hallucinated comments. On 200 real PRs across 10 languages with 1,505 expert-verified comments: 25.10% SEM-F1 versus 11.57% for baseline agents. Put triage in rules, spend model budget on grounded reading.
Each link below shares sources, entities, or timing with this story.
Simon Willison released LLM / Shared entity: PRs / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover PRs; reported by the same outlet (arxiv.org).
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (caps, context).
Shared entities / Same source / Shared topic / Tension
Both cover OpenCodeReview, SEM; cite the same source (OpenCodeReview (arXiv 2608.09290)); overlapping topics (against, budget, comment, criteria, curated).
Simon Willison released LLM / Shared entity: LLM / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; overlapping topics (agent, argu).
Simon Willison released LLM / Same source domain / Shared topic
Linked by a graph relationship (Simon Willison released LLM); reported by the same outlet (arxiv.org); overlapping topics (agent, beat, deterministic).
Simon Willison released LLM / Shared entity: LLM / Earlier coverage / Tension
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-19.
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-06-18.
Simon Willison released LLM / Shared entity: LLM / Earlier coverage
Linked by a graph relationship (Simon Willison released LLM); both cover LLM; earlier LLM coverage from 2026-07-31.