Fetching from the wire…
01
02
03
04
05
06
07
08
Top 5 · 2026-04-06 · source-backed
Here's a stat that should change how you plan your engineering workflow: OpenAI Codex has generated over 400,000 pull requests in two months. Code review agents are no longer experimental. They're routine gatekeepers in development workflows at scale.
So researchers did what nobody in the vendor ecosystem bothered to do. They empirically measured how well code review agents actually perform against the industry claim that they can manage 80% of PRs without human involvement.
The results challenge that number. I don't have the full paper's exact findings yet, but the framing is clear: there's a gap between what vendors promise and what the data shows when you test at scale. This is the first large-scale empirical reality check on automated code review, and it arrives at exactly the moment when agent-generated PR volume is exploding.
This connects directly to the "silent fake success" pattern that hit 406 upvotes on r/ClaudeAI this weekend. Heavy Claude Code users identified their biggest time sink: the agent reports task completion without errors but produces subtly incorrect output. 138 comments. A 0.34 comment ratio, meaning people aren't just upvoting, they're sharing their own experiences with phantom completions.
The pattern is consistent. AI tools are phenomenal at generating plausible-looking work. They're mediocre at self-assessment. And the tools we use to review AI work (which are themselves AI) inherit the same blind spots.
What I'm doing about this: test-first development isn't just good practice anymore, it's the verification layer you can't skip. Write the test before you let the agent write the code. If the agent generates a PR, don't trust the diff. Run the tests. Read the actual output. The 80% automation number might be real someday, but today the builders who verify will outship the builders who trust.
Each link below shares sources, entities, or timing with this story.
Simon Willison uses OpenAI Codex / Shared entity: PRs / Same source domain / Shared topic / What happened next / Tension
Linked by a graph relationship (Simon Willison uses OpenAI Codex); both cover PRs; reported by the same outlet (arxiv.org).
Simon Willison uses OpenAI Codex / Shared entity: ClaudeAI / Same source domain / Shared topic / What happened next
Linked by a graph relationship (Simon Willison uses OpenAI Codex); both cover ClaudeAI; reported by the same outlet (arxiv.org, reddit.com).
Claude Code competes with OpenAI Codex / Shared entities / Same source domain / Shared topic / What happened next
Linked by a graph relationship (Claude Code competes with OpenAI Codex); both cover ClaudeAI, Code; reported by the same outlet (arxiv.org, reddit.com).
Simon Willison uses OpenAI Codex / Shared entity: ClaudeAI / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Simon Willison uses OpenAI Codex); both cover ClaudeAI; reported by the same outlet (reddit.com).
Claude Code competes with OpenAI Codex / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Claude Code competes with OpenAI Codex); both cover OpenAI Codex, PRs; overlapping topics (agent, code, review).
Claude Code competes with OpenAI Codex / Shared entities / Shared topic / What happened next
Linked by a graph relationship (Claude Code competes with OpenAI Codex); both cover Agent, PRs, Write; overlapping topics (agent, code, development).
Linked by a graph relationship (Claude Code competes with OpenAI Codex); both cover Agent, Code, PRs; overlapping topics (agent, code, output).
Claude Code competes with OpenAI Codex / Shared entity: ClaudeAI / Same source domain / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Claude Code competes with OpenAI Codex); both cover ClaudeAI; reported by the same outlet (reddit.com).