NVIDIA Releases gpt-oss-puzzle-88B — Deployment-Optimized Distillation of OpenAI's 120B with 1.2-2.8x Throughput Gains

r/LocalLLaMA / Hugging Face / NVIDIA·medium signal

NVIDIA published gpt-oss-puzzle-88B on Hugging Face, a deployment-optimized 88B parameter model distilled from OpenAI's gpt-oss-120b using Puzzle NAS. The framework prunes MoE expert counts layer-wise, converts global attention to windowed forms, and quantizes KV-caches to FP8, achieving 1.22-2.82x higher per-token throughput with slight accuracy retention at all chain-of-thought effort levels. Optimized for H100 GPUs with 128K context length. This represents NVIDIA's continuing push into the open-source model distribution layer — making it easier to deploy frontier-class reasoning models in production.