Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-21 · high
Zhang and Gross's method scores samples by perplexity and holds up across plain language modeling and reasoning fine-tunes, per the preprint.
Why now: The preprint was covered in the July 21 briefing.
PPL-Factory scores fine-tuning samples by perplexity and picks them to fit a fixed compute budget, per a preprint from McGill's Zhang and Gross. The preprint frames that as the realistic setup: rationed compute, not an unlimited corpus and an unlimited GPU pool. Selection under that kind of ceiling is the actual problem, not a side case.
The method is both task-aware and budget-aware. Zhang and Gross test it across plain language modeling and reasoning fine-tunes, per the preprint. Reasoning data behaves differently enough from general text that testing both is the harder claim to defend.
A sample can score as informative under perplexity and still be a bad example for teaching a model to reason. Surprising isn't the same as right. That's a gap the language modeling result alone wouldn't expose.
The preprint summary doesn't say how much compute the method saves against full-dataset fine-tuning, or which base models Zhang and Gross ran it on.
Each link below shares sources, entities, or timing with this story.
Factory uses Claude / Shared entity: GPUs / Shared topic / Earlier coverage
Linked by a graph relationship (Factory uses Claude); both cover GPUs; overlapping topics (compute, gpus).
Factory uses Claude / Shared entity: Gross / Earlier coverage / Tension
Linked by a graph relationship (Factory uses Claude); both cover Gross; earlier Gross coverage from 2026-04-30.
Shared entity: GPUs / Shared topic / Earlier coverage / Tension
Both cover GPUs; overlapping topics (compute, data, gpus); earlier GPUs coverage from 2026-05-09.
Both cover GPUs; overlapping topics (compute, gpus); earlier GPUs coverage from 2026-06-26.
Shared entity: GPUs / Shared topic / Earlier coverage
Both cover GPUs; overlapping topics (budget, compute, gpus); earlier GPUs coverage from 2026-03-20.
Shared entity: GPUs / Same source domain / Earlier coverage
Both cover GPUs; reported by the same outlet (arxiv.org); earlier GPUs coverage from 2026-07-20.
Factory uses Claude / Same source domain
Linked by a graph relationship (Factory uses Claude); reported by the same outlet (arxiv.org).
Linked by a graph relationship (Factory uses Claude); reported by the same outlet (arxiv.org).