Fetching from the wire…
Public story · 2026-07-31 · high
The model beat a ten-turn budget and an oracle-guided baseline while averaging just 2.99 turns per answer.
Why now: This result is covered in the July 31 research briefing, and its accuracy claims rest only on the seven math benchmarks tested so far.
SVR trains a 2-billion-parameter model to stop answering once it's confident, skipping a fixed turn budget, per the paper.
Multi-turn RL systems typically pay for every extra turn, either running a fixed budget or adding an outside grader to catch answers early. Qwen3.5-2B trained with SVR hit 0.563 macro-average accuracy across seven math benchmarks in 2.99 turns instead of ten, beating GRPO and an oracle-guided baseline.
The self-grading is the design choice that makes this work. Each turn, the model outputs a solution plus its own verdict, correct or incorrect, and a confidence score. It only locks in an answer once the verdict says correct and confidence clears a set threshold.
Ground-truth correctness only shapes the reward signal during training, the paper says. The model never sees the right answer while deciding whether to stop.
SVR also beat a fixed-budget baseline that used oracle guidance on when to stop. That result suggests the model's learned confidence signal can outperform an external judge making the same call.
The paper's numbers all come from math benchmarks, where answers are easy to grade against ground truth. Whether the same self-grading trick holds up on tasks without a clean answer is untested.
Each link below shares sources, entities, or timing with this story.
Unsloth released GRPO / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Unsloth released GRPO); both cover GRPO, Qwen3; earlier GRPO coverage from 2026-06-20.
GRPO competes with PPO / Shared entity: GRPO / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (GRPO competes with PPO); both cover GRPO; reported by the same outlet (arxiv.org).
Unsloth released GRPO / Shared entity: Qwen3 / Earlier coverage / Tension
Linked by a graph relationship (Unsloth released GRPO); both cover Qwen3; earlier Qwen3 coverage from 2026-04-23.
Unsloth released GRPO / Shared entity: Qwen3 / Earlier coverage
Linked by a graph relationship (Unsloth released GRPO); both cover Qwen3; earlier Qwen3 coverage from 2026-07-11.
Unsloth released GRPO
Linked by a graph relationship (Unsloth released GRPO).
Unsloth released GRPO / Shared topic
Linked by a graph relationship (Unsloth released GRPO); overlapping topics (benchmark, model).
Shared entity: GRPO / Same source domain / Shared topic / Earlier coverage
Both cover GRPO; reported by the same outlet (arxiv.org); overlapping topics (average, benchmark, model).
Both cover GRPO; reported by the same outlet (arxiv.org); overlapping topics (average, benchmark, correct).