Reddit
AntLing Open-Sourced Six Ling-3.0 Base Checkpoints With No Post-Training, Including Mid-Train and WSM-Merged Stages
AntLing announced six base checkpoints for Ling-3.0-tiny (7.9B total, 1.3B active) and Ling-3.0-flash (124B total, 5.1B active) covering pre-trained, mid-trained and WSM-merged stages, none of them post-trained. The interesting method claim is WSM, which replaces learning-rate decay with weighted checkpoint merging so continual pre-training can explore different decay strategies offline. Worth noting for anyone tracking recency: the Hugging Face repos (inclusionAI/Ling-3.0-tiny-base, -midtrain, -30T and the flash equivalents) were actually uploaded on 2026-08-11 and only publicized on Reddit nine days later, and download counts are still tiny at 177 to 453.
↳ Follow the thread