Fetching from the wire…
Models2026-07-28 · source-backed
Korea's Upstage released a commercially usable agent-first MoE (320 routed + 1 shared experts, top-8) trained on ~12T tokens over 2M B200 GPU-hours. The architecture is deliberately serving-cheap: hybrid softmax + linear attention in a [Softmax, Linear×3]×12 pattern with NoPE and 1M context, fitting four H200s in BF16 or two quantized. CEO Kim Sung-hun pointedly contrasted this with models needing 16 B200s. Reported: 70.4 SWE-Bench Verified, 92.4 LiveCodeBench, 86.2 MMLU-Pro, 58.2 MCP-Atlas tool calling. Their Selective Weight Transfer init hit target loss in ~12B tokens versus ~22B for random. (Upstage)
Each link below shares sources, entities, or timing with this story.
Anthropic released MCP / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Anthropic released MCP); both cover Bench Verified, MoE, SWE; earlier Bench Verified coverage from 2026-04-21.
Claude uses MCP / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Claude uses MCP); both cover LiveCodeBench, MoE, SWE; overlapping topics (active, attention, context, token).
Atlas built by OpenAI / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Atlas built by OpenAI); both cover MoE, SWE; earlier MoE coverage from 2026-06-07.
Claude Code uses MCP / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Claude Code uses MCP); both cover MoE, SWE; earlier MoE coverage from 2026-04-23.
Atlas built by OpenAI / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Atlas built by OpenAI); both cover MoE, SWE; earlier MoE coverage from 2026-04-20.
Claude Code uses MCP / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Claude Code uses MCP); both cover MoE, SWE; earlier MoE coverage from 2026-03-10.
Claude Code uses MCP / Shared entities / Shared topic
Linked by a graph relationship (Claude Code uses MCP); both cover MoE, SWE; overlapping topics (context, token).
Atlas built by OpenAI / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Atlas built by OpenAI); both cover Bench Verified, MoE, SWE; overlapping topics (attention, context).