← The Wire

Public story · 2026-03-04 · source-backed

AlgoVeri — Formal Verification Benchmark

Confidence
source-backed
Sources
1
Redaction
passed

Story

First cross-language benchmark for formally verified code generation: 40.3% success in Dafny, 24.7% Verus, 7.8% Lean. LLMs handle high-level verified code but collapse on systems-level constraints and manual proofs. (arXiv 2602.09464)

Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entity: LLMs / Same source domain / Shared topic / What happened next

    CodeSpear: a benign code grammar constraint jailbreaks LLMs into malicious code.

    Both cover LLMs; reported by the same outlet (arxiv.org); overlapping topics (code, constraint).

  2. Shared entity: Lean / Same source domain / Shared topic / What happened next

    Anthropic released Opus 4.8 on May 28, and the formal-methods jump is showing up everywhere.

    Both cover Lean; reported by the same outlet (arxiv.org); overlapping topics (formal, formally).

  3. Shared entity: LLMs / Same source domain / Shared topic / What happened next

    Sleeper Cell Backdoors in Fine-Tuned Models: Poisoned LoRAs Pass All Benchmarks

    Both cover LLMs; reported by the same outlet (arxiv.org); overlapping topics (benchmark, formal).

  4. Shared entity: LLMs / Same source domain / What happened next / Downstream implication

    Evaluator bias is contagious in multi-agent systems.

    Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-19.

  5. A few visual cues drive most MLLM social bias.

    Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-19.

  6. Human and LLM everyday reasoning are both pattern matching, not world models.

    Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-14.

  7. Shared entity: LLMs / Same source domain / What happened next / Tension

    The "self-correction illusion" is the most useful empirical result of the day.

    Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-06-09.

  8. Your AI-Generated Code Compiles. It Doesn't Work.

    Both cover LLMs; reported by the same outlet (arxiv.org); picks up the LLMs thread on 2026-04-22.

Source trail

Entities

Provenance

AI generated
no
Story unit
2026-03-04-algoveri-formal-verification-benchmark
Labels
source-backed, canonical briefing excerpt