Fetching from the wire…
01
02
03
04
05
06
07
08
Models2026-08-30 · source-backed
The AngelSlim/Hy4-preview-GGUF repo offers Q4_K_M at 435.20 GiB (4.86 bpw) and STQ1_0 at 213.66 GiB (2.38 bpw), benchmarked at 204.56 t/s prefill and 20.47 t/s decode on 8x H20. STQ1_0 comes from llama.cpp PR #22836 and uses ternary weights with 3:4 forced sparsity at 1.3125 bpw on routed-expert gate/up projections across 29 layers, with IQ2_XXS at 2.0625 bpw on the other 48. An imatrix is mandatory. (Hugging Face) The r/LocalLLaMA thread (821 upvotes) circulated a ~98% performance retention claim, and the top skeptical reply notes 98% on KL divergence alone can be misleading. I'd want task benchmarks before believing that number.
Each link below shares sources, entities, or timing with this story.
Tencent released Hy3 / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Tencent released Hy3); both cover Hugging Face, Hy4, Tencent; reported by the same outlet (huggingface.co).
Hugging Face partners with NVIDIA / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Hugging Face partners with NVIDIA); both cover Hugging Face, LocalLLaMA, Tencent; reported by the same outlet (huggingface.co).
Tencent released Hy3 / Shared entities / Earlier coverage
Linked by a graph relationship (Tencent released Hy3); both cover AngelSlim, Hugging Face, Tencent; earlier AngelSlim coverage from 2026-07-15.
Hy4 built by Tencent / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Hy4 built by Tencent); both cover Hugging Face, Tencent; reported by the same outlet (huggingface.co).
Hugging Face partners with NVIDIA / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Hugging Face partners with NVIDIA); both cover GGUF, Hugging Face, LocalLLaMA; reported by the same outlet (huggingface.co).
Tencent released CodeBuddy / Shared entities / Earlier coverage
Linked by a graph relationship (Tencent released CodeBuddy); both cover Hy4, Tencent; earlier Hy4 coverage from 2026-08-28.
Hugging Face released Safetensors / Shared entities / Earlier coverage
Linked by a graph relationship (Hugging Face released Safetensors); both cover Hugging Face, LocalLLaMA; earlier Hugging Face coverage from 2026-07-27.
Claude Code uses Hugging Face / Shared entities / Earlier coverage
Linked by a graph relationship (Claude Code uses Hugging Face); both cover GGUF, LocalLLaMA; earlier GGUF coverage from 2026-07-26.