Qwen3-TTS Voice Cloning Landed in Mainline llama.cpp After a PR the Author Once Said Would Never Merge — 42 Files, 3,788 Lines
llama.cpp PR #26254 by ngxson merged 2026-08-04 at 15:26 UTC, adding Qwen3-TTS support to mtmd with a breaking change to the llama-tts binary: 42 files changed, 3,788 additions. It targets Qwen/Qwen3-TTS-12Hz-1.7B-Base with `--tts-lang` across 10 languages and `--tts-speaker-file` pointing at a reference wav/mp3, so voice cloning is a single CLI invocation against a GGUF. The r/LocalLLaMA thread (168 upvotes) notes the earlier demo PR was expected never to merge because llama.cpp lacked the graph and API pieces. The architecture mirrors Sesame CSM: a speaker encoder projects reference audio into text embedding space, a causal talker backbone samples the semantic codebook, and a code predictor emits the remaining 15 acoustic tokens per step. A companion PR (#26603) adding a server `POST /tts` endpoint is still open.
↳ Follow the thread