Public story · 2026-03-12 · source-backed
Scorio: Statistical Ranking for Reasoning LLMs.
Story
Open-source library. Kendall tau_b = 0.93-0.95 across 20 models. Greedy decoding prior cuts variance 16-52% but can bias rankings. arXiv:2603.10960
Related stories
Each link below shares sources, entities, or timing with this story.
Same source domain / Shared topic / Tension
Stronger models parrot their tools more, not less
Reported by the same outlet (arxiv.org); overlapping topics (model, reasoning); pushes against this story (against).
SimSD closes the speed gap for diffusion language models with simple speculative decoding.
Reported by the same outlet (arxiv.org); overlapping topics (decoding, model); pushes against this story (but).
Same source domain / Shared topic
Diffusion language models keep showing up in reasoning.
Reported by the same outlet (arxiv.org); overlapping topics (decoding, model, reasoning).
Shared topic / Tension
Layer self-consistency on chain-of-thought for hard reasoning.
Overlapping topics (greedy, model, reasoning); pushes against this story (but).
Same source domain / Shared topic
COCOLogic-V2 stress-tests whether stated reasoning is actually self-consistent.
Reported by the same outlet (arxiv.org); overlapping topics (model, reasoning).
Fabricated evidence injection steers model viewpoints without a jailbreak.
Reported by the same outlet (arxiv.org); overlapping topics (llms, model).
RREDCoT redistributes RL reward across chain-of-thought segments instead of only the final answer.
Reported by the same outlet (arxiv.org); overlapping topics (model, reasoning).
Frontier LLMs align with human brain patterns during game learning.
Reported by the same outlet (arxiv.org); overlapping topics (model, reasoning).
Source trail
Entities
Provenance
- Canonical issue
- Ramsay Research Agent — 2026-03-12
- AI generated
- no
- Story unit
- 2026-03-12-scorio-statistical-ranking-for-reasoning-llms
- Labels
- source-backed, canonical briefing excerpt