Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-17 · high
S²VOPD trains the model against a degraded view of itself, no labels needed, lifting the score from 70.7% to 77.4%.
Why now: The comparison surfaces in the August 17 research briefing, where cutting distillation costs is the throughline.
S²VOPD raised Qwen3.5-4B's fine-grained perception score from 70.7% to 77.4% by making the model its own teacher, a twist on visual on-policy distillation, per the paper.
On-policy distillation usually needs a stronger teacher model or privileged supervision to work at all. S²VOPD skips both. The same model reads a clean image as the teacher and a strongly augmented version of that image as the student. The training signal comes from the gap between the two, with no annotations, rewards, or second model involved.
The gain held up against competition. Qwen3.5-4B outscored every open-source model in the comparison, including the 235-billion-parameter Qwen3-VL, and GPT-5.4 too.
The paper's ablations matter more than the leaderboard number. All four augmentation families it tested helped. Symmetric self-distillation, where the model isn't degraded differently as student and teacher, hurt performance. And augmentations strong enough to erase the image evidence the question depended on produced large gradients that taught the model nothing useful.
The benchmark win is easy to repeat. The ablations are the harder part to copy. Augmentation strength has to sit in a narrow band. It must be strong enough to force learning, but not so strong it erases the answer. Teams that skip that tuning, and just point a model at itself symmetrically, will see this method underperform for them specifically.
The comparison surfaces in the August 17 research briefing, where cutting distillation costs is the throughline.
Each link below shares sources, entities, or timing with this story.
GPT competes with Claude / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (GPT competes with Claude); both cover GPT, Qwen3; reported by the same outlet (arxiv.org).
GPT competes with Claude / Shared entity: GPT / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (GPT competes with Claude); both cover GPT; reported by the same outlet (arxiv.org).
Linked by a graph relationship (GPT competes with Claude); both cover GPT; reported by the same outlet (arxiv.org).
OpenHands uses GPT / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (OpenHands uses GPT); both cover GPT, Qwen3; reported by the same outlet (arxiv.org).
GPT competes with DeepSeek / Shared entity: Qwen3 / Shared topic / Earlier coverage
Linked by a graph relationship (GPT competes with DeepSeek); both cover Qwen3; overlapping topics (benchmark, model).
GPT competes with Claude / Shared entity: GPT / Same source domain / Earlier coverage
Linked by a graph relationship (GPT competes with Claude); both cover GPT; reported by the same outlet (arxiv.org).
Linked by a graph relationship (GPT competes with Claude); both cover GPT; reported by the same outlet (arxiv.org).
Linked by a graph relationship (GPT competes with Claude); both cover GPT; reported by the same outlet (arxiv.org).