Fetching from the wire…
01
02
03
04
05
06
07
08
Models2026-08-09 · source-backed
Two artifacts: a training subset of 15.9 TB / ~4.9T tokens from 173M repositories, and a full pre-filter corpus of 113.7 TB across 770 languages from 224M repositories, crawl cutoff August 7 2025, ODC-By v1.0 with source files keeping original licenses (Hugging Face). The scale jump over v2 is roughly 9x in training tokens (550B → 4.9T), but the operationally important change is that file contents are embedded inline rather than referenced by file ID. Self-contained instead of requiring a separate fetch. Dedup moved to language-agnostic near-dedup with Jaccard verification after connected-component clustering, rows grouped one-per-repository for full-repo-context pretraining, opt-outs removed before each patch release. 182,428 downloads last month.
Each link below shares sources, entities, or timing with this story.
Hugging Face released Safetensors / Shared entity: Hugging Face / Earlier coverage
Linked by a graph relationship (Hugging Face released Safetensors); both cover Hugging Face; earlier Hugging Face coverage from 2026-07-27.
Hugging Face criticizes OpenAI / Shared entity: Hugging Face / Earlier coverage
Linked by a graph relationship (Hugging Face criticizes OpenAI); both cover Hugging Face; earlier Hugging Face coverage from 2026-07-27.
Linked by a graph relationship (Hugging Face criticizes OpenAI); both cover Hugging Face; earlier Hugging Face coverage from 2026-07-25.
Hugging Face partners with Open Secure AI Alliance / Shared entities / Earlier coverage
Linked by a graph relationship (Hugging Face partners with Open Secure AI Alliance); both cover August, Hugging Face; earlier August coverage from 2026-08-05.
Hugging Face criticizes OpenAI / Shared entity: Hugging Face / Same source domain / Earlier coverage
Linked by a graph relationship (Hugging Face criticizes OpenAI); both cover Hugging Face; reported by the same outlet (huggingface.co).
Hugging Face criticizes OpenAI / Shared entity: Hugging Face / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Hugging Face criticizes OpenAI); both cover Hugging Face; reported by the same outlet (huggingface.co).
Hugging Face criticizes OpenAI / Shared entity: August / Earlier coverage
Linked by a graph relationship (Hugging Face criticizes OpenAI); both cover August; earlier August coverage from 2026-08-07.
Hugging Face partners with NVIDIA / Shared entity: August / Earlier coverage
Linked by a graph relationship (Hugging Face partners with NVIDIA); both cover August; earlier August coverage from 2026-08-05.