Qwen 3.6 Wins Benchmarks, Gemma 4 Wins Reality: 7 Lessons from Local Vision Model Testing

r/LocalLLaMA·medium signal

A detailed r/LocalLLaMA post comparing Qwen 3.6 and Gemma 4 27B/31B vision models under vLLM/FP8 across community-submitted hard use cases found that Qwen 3.6 leads on published benchmarks while Gemma 4 consistently performs better on real-world tasks. The post hit 72 upvotes with 57 comments — an unusually high comment-to-score ratio (0.79) indicating deep technical engagement. The author coins 'benchmaxing' as a term for models optimized for leaderboard performance that underperform in practice, a pattern increasingly visible at the 27-31B tier.