NVIDIA Nemotron 3 Super 120B Released at GTC: Hybrid Mamba-Transformer MoE, 12B Active Parameters, 2.2x Throughput

NVIDIA Blog·high signal

NVIDIA released Nemotron 3 Super at GTC 2026 — a 120-billion-parameter hybrid Mamba-Transformer Mixture-of-Experts model with only 12 billion active parameters per token, a 1 million token context window, and 2.2x throughput improvement over the prior generation. Designed for enterprise inference at scale, the model targets organizations running high-volume agent workloads where per-token compute cost is the primary constraint. It pairs directly with the DGX Spark hardware via the OpenClaw Playbook for on-premises multi-agent deployments.