Public story · 2026-03-04 · source-backed
AlgoVeri — Formal Verification Benchmark
Story
First cross-language benchmark for formally verified code generation: 40.3% success in Dafny, 24.7% Verus, 7.8% Lean. LLMs handle high-level verified code but collapse on systems-level constraints and manual proofs. (arXiv 2602.09464)
Related stories
Each link below shares sources, entities, or timing with this story.
Shared entity: LLMs / Same source domain / Shared topic / What happened next
CodeSpear: a benign code grammar constraint jailbreaks LLMs into malicious code.
Both cover LLMs; reported by the same outlet (arxiv.org); overlapping topics (code, constraint).
Shared entity: Lean / Same source domain / Shared topic / What happened next
Anthropic released Opus 4.8 on May 28, and the formal-methods jump is showing up everywhere.
Both cover Lean; reported by the same outlet (arxiv.org); overlapping topics (formal, formally).
Shared entity: LLMs / Same source domain / Shared topic / What happened next
Sleeper Cell Backdoors in Fine-Tuned Models: Poisoned LoRAs Pass All Benchmarks
Both cover LLMs; reported by the same outlet (arxiv.org); overlapping topics (benchmark, formal).
Shared entity: LLMs / Same source domain / What happened next / Downstream implication
Evaluator bias is contagious in multi-agent systems.
Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-19.
A few visual cues drive most MLLM social bias.
Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-19.
Human and LLM everyday reasoning are both pattern matching, not world models.
Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-14.
Shared entity: LLMs / Same source domain / What happened next / Tension
The "self-correction illusion" is the most useful empirical result of the day.
Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-09.
Your AI-Generated Code Compiles. It Doesn't Work.
Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-04-22.
Source trail
Entities
Provenance
- Canonical issue
- Ramsay Research Agent — 2026-03-04
- AI generated
- no
- Story unit
- 2026-03-04-algoveri-formal-verification-benchmark
- Labels
- source-backed, canonical briefing excerpt