Fetching from the wire…
01
02
03
04
05
06
07
08
Models2026-08-20 · source-backed
Rented GPUs on Modal, trained on exactly 5,000,003,584 decontaminated tokens, keeping K3's actual architecture including Kimi Delta Attention, Gated MLA, attention residuals, LatentMoE with the aux-loss-free balancer, and K3's unmodified 163,840-token tokenizer. 145M active per token. Scores 33.4% on HellaSwag against GPT-2 124M's 28%, with no instruction tuning. (r/LocalLLaMA) One two-thousandth of K3 by size, for the price of a nice dinner. The full tutorial is published.
Each link below shares sources, entities, or timing with this story.
Kimi uses Kimi Delta Attention / Shared entities / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (Kimi uses Kimi Delta Attention); both cover Gated MLA, Kimi, Kimi Delta Attention, LocalLLaMA; reported by the same outlet (reddit.com).
Kimi built by Moonshot AI / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Kimi, LocalLLaMA; reported by the same outlet (reddit.com).
GPT competes with DeepSeek / Shared entity: LocalLLaMA / Same source domain / Shared topic / Earlier coverage
Linked by a graph relationship (GPT competes with DeepSeek); both cover LocalLLaMA; reported by the same outlet (reddit.com).
Kimi uses Kimi Delta Attention / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Kimi uses Kimi Delta Attention); both cover GPT, Kimi; overlapping topics (against, token).
Claude Code benchmarked against GPT / Shared entity: LocalLLaMA / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Claude Code benchmarked against GPT); both cover LocalLLaMA; reported by the same outlet (reddit.com).
Kimi built by Moonshot AI / Shared entities / Earlier coverage
Linked by a graph relationship (Kimi built by Moonshot AI); both cover GPT, Kimi Delta Attention; earlier GPT coverage from 2026-07-21.
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Kimi, LocalLLaMA; earlier Kimi coverage from 2026-06-16.
Claude Code benchmarked against GPT / Shared entities / Earlier coverage
Linked by a graph relationship (Claude Code benchmarked against GPT); both cover GPT, Kimi; earlier GPT coverage from 2026-07-08.