Reddit
MiMo-V2.6-Flash's 'empty responses' on vLLM are a serving bug, and a template fix makes it beat GLM-5.3 for one agent user
The poster ran MiMo-V2.6-Flash-RL on 2x DGX Spark with vLLM. With streaming and thinking on, every reply after the first turn came back as unclosed <think> content. The cause: vLLM's is_reasoning_end check finds </think> from earlier assistant turns in the prompt and concludes reasoning has already ended. Pre-opening <think> in the generation prompt fixes it, and the post also flags a hidden 2,048-token output cap (r/LocalLLaMA, 17 upvotes). With the fixes applied, the author found it better than GLM-5.3, but at max effort it thought for over 30 minutes, so medium effort is the practical setting.
↳ Follow the thread