Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-07-20 · high
MoE models are usually the efficiency play, but long-context serving makes expert weights and cache fight over the same GPU memory.
Why now: Dated to the July 20 briefing that surfaced arXiv 2607.16184.
PagedWeight quantizes each expert page independently instead of picking one bit-width for the whole MoE model, per arXiv 2607.16184.
MoE models are usually the efficiency pick over dense ones. That flips once long-context serving pushes them memory-bound, since expert weights and cache compete for the same HBM. For anyone self-hosting Qwen or DeepSeek on a fixed GPU budget, that's the difference between one card and two, a straight 2x cost swing.
The paper's fix is quality-aware, dynamic quantization applied per page rather than a flat bit-width across every expert. That's a narrower move than shrinking the whole model to save memory. It's aimed at freeing room for the KV cache without giving up precision everywhere.
Whether that holds outside the paper's own tests is the open question. If per-page quantization keeps its accuracy edge in other serving stacks, the one-GPU-or-two call for self-hosted Qwen and DeepSeek changes. It moves from a hardware budget line to a config flag. That's the kind of change that shows up in an infra bill before it shows up in a benchmark chart.
Each link below shares sources, entities, or timing with this story.
DeepSeek partners with Huawei / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (DeepSeek partners with Huawei); both cover DeepSeek, MoE; overlapping topics (cache, cost, deepseek).
DeepSeek competes with Anthropic / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek competes with Anthropic); both cover DeepSeek, MoE, Qwen; earlier DeepSeek coverage from 2026-05-01.
Ollama supports DeepSeek / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Ollama supports DeepSeek); both cover MoE, Qwen; earlier MoE coverage from 2026-04-23.
DeepSeek competes with Anthropic / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (DeepSeek competes with Anthropic); both cover MoE, Qwen; earlier MoE coverage from 2026-04-21.
Linked by a graph relationship (DeepSeek competes with Anthropic); both cover DeepSeek, MoE; earlier DeepSeek coverage from 2026-04-20.
DeepSeek competes with Anthropic / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek competes with Anthropic); both cover DeepSeek, Qwen; earlier DeepSeek coverage from 2026-06-25.
Ollama supports DeepSeek / Shared entities / Earlier coverage
Linked by a graph relationship (Ollama supports DeepSeek); both cover DeepSeek, Qwen; earlier DeepSeek coverage from 2026-05-10.
DeepSeek released V4 Preview / Shared entities / Earlier coverage
Linked by a graph relationship (DeepSeek released V4 Preview); both cover DeepSeek, MoE; earlier DeepSeek coverage from 2026-04-24.