Fetching from the wire…
Public story · 2026-08-30 · source-backed
A 135-upvote r/LocalLLaMA post catalogs them: an RFC for a MoE expert cache keeping hot CPU-resident experts in VRAM with hybrid hit/miss execution (#24528), AVX2 large-batch IQ prefill (#27402), tiled mul_mat for k-quants (#27851), AVX-512/VNNI paths for Q5_K/Q6_K (#27590), x86 VNNI Q2_0 claiming 3x (#26348), a pshard runtime for plan switching and streamed weights (#22692), and streaming MoE routed experts from disk (#25294). (r/LocalLLaMA) A commenter notes PRs dating to 2023.
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover CPU, LocalLLaMA, VRAM; reported by the same outlet (reddit.com); overlapping topics (cache, commenter).
Shared entities / Same source domain / Earlier coverage / Tension
Both cover LocalLLaMA, MoE, VRAM; reported by the same outlet (reddit.com); earlier LocalLLaMA coverage from 2026-07-27.
Shared entities / Same source domain / Earlier coverage / Downstream implication
Both cover CPU, LocalLLaMA, VRAM; reported by the same outlet (reddit.com); earlier CPU coverage from 2026-04-10.
Shared entities / Earlier coverage
Both cover CPU, LocalLLaMA, MoE, VRAM; earlier CPU coverage from 2026-08-27.
Shared entities / Same source domain / Earlier coverage
Both cover LocalLLaMA, MoE, VRAM; reported by the same outlet (reddit.com); earlier LocalLLaMA coverage from 2026-08-18.
Both cover LocalLLaMA, MoE, VRAM; reported by the same outlet (reddit.com); earlier LocalLLaMA coverage from 2026-05-22.
Both cover LocalLLaMA, MoE, VRAM; reported by the same outlet (reddit.com); earlier LocalLLaMA coverage from 2026-04-05.
Shared entities / Same source domain / Earlier coverage / Downstream implication
Both cover CPU, LocalLLaMA; reported by the same outlet (reddit.com); earlier CPU coverage from 2026-05-10.