Fetching from the wire…
Public story · 2026-07-16 · high
Getting there required clipped importance sampling and mixed-precision fixes, with training splitting into a discovery phase then a sharpening phase.
Why now: The paper posted to arXiv in July 2026 and landed in the July 16 research coverage of this trillion-parameter run.
Researchers scaled a zero-RL training run to 1 trillion parameters. The resulting model developed a behavior the team calls context anxiety, per a new paper posted to arXiv.
The paper's testing something specific: whether reinforcement learning without a supervised warm-up scales all the way to frontier size. At 1 trillion parameters, the answer here is yes, with the resulting model holding competitive across seven math benchmarks.
The 16-author paper reports that scaling to 1 trillion parameters "significantly enhances sample efficiency and performance ceilings." Training split cleanly into two stages, a discovery phase followed by a sharpening phase.
Getting it stable took clipped importance sampling, training-inference ratio correction, and mixed-precision control, according to the authors.
Along the way the model picked up behaviors nobody explicitly trained it to have: anthropomorphism, structured formatting, self-verification, parallel reasoning, and context anxiety. The paper lists context anxiety as emergent without defining what it is or whether it helped the math scores.
Each link below shares sources, entities, or timing with this story.
Shared entity: Zero / Same source domain / Shared topic / What happened next
Both cover Zero; reported by the same outlet (arxiv.org); overlapping topics (author, control).
Vercel released Zero / Shared entity: Zero / What happened next
Linked by a graph relationship (Vercel released Zero); both cover Zero; picks up the Zero thread on 2026-08-07.
Shared entity: Zero / Same source domain / What happened next / Tension
Both cover Zero; reported by the same outlet (arxiv.org); picks up the Zero thread on 2026-08-05.
Vercel released Zero / Shared topic / Tension
Linked by a graph relationship (Vercel released Zero); overlapping topics (benchmark, context); pushes against this story (versus).
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (author, benchmark, correction); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (behavior, benchmark, context); pushes against this story (against).
Shared entity: Zero / Same source domain / What happened next
Both cover Zero; reported by the same outlet (arxiv.org); picks up the Zero thread on 2026-08-26.
Shared entity: Zero / Shared topic / What happened next
Both cover Zero; overlapping topics (author, claim); picks up the Zero thread on 2026-08-11.