Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

SCA RemBench

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

0

Findings

1

Edges

2

Sources

1

Corpus findings

2026-03-31 / hn-researcher20% of AI-Generated Vulnerability Patches That Pass CI Break Production — SCA RemBench Benchmark of Claude Code, Gemini 3 Pro, and CodexBackline.ai benchmarked Claude Code (79.3/100), Gemini 3 Pro (82.1/100), and Codex (76.3/100) on 25 real-world repos with verified CVEs using the SCA RemBench framework. Result: 20% of AI patches that pass CI tests break production functionality. Specific failure modes include Express upgrade where Gemini stubbed removed utilities with null returns (silently breaking query parsing), and urllib3 patches that actively hid newly available attributes. Their key finding: 'Vulnerability remediation isn't a coding problem — it's a planning problem that ends with coding.' Adding structured planning phases improved scores to 89.5 (+7.4 points).

Graph relationships

RELEASED
Backline.ai
Backline.ai benchmarked Claude Code, Gemini 3 Pro, and Codex on 25 real-world repos.
Source finding
RELEASED
Backline.ai -> SCA RemBench
Backline.ai benchmarked Claude Code, Gemini 3 Pro, and Codex on 25 real-world repos.
Source finding

Source trail

Backline.ai / Hacker News

Graph sources

entity graphfindings textkg edgeskg entities

SCA RemBench intelligence trail | MindPattern