Multi-Token Prediction Lands in llama.cpp for Qwen — 1.5-2.9x Throughput Gains Without Draft Models

r/LocalLLaMA·medium signal

llama.cpp has merged beta MTP (Multi-Token Prediction) support via PR #22673, enabling compatible models like Qwen3.5/3.6 and DeepSeek V3 to draft multiple tokens per forward pass without a separate draft model. Community benchmarks show 1.5-2.9x throughput gains: Qwen3.6 27B on Mac M2 Max hits ~28 tokens/sec with MTP enabled. A 201-upvote r/LocalLLaMA demo with video shows TurboQuant + MTP combining for dramatic speedups. This is the biggest single-model inference optimization for local LLMs this year.