Someone benchmarked 21 Qwen3.8-27B quants on a 16GB card by mean KLD against real C code
r/LocalLLaMA (223 upvotes)·medium signal
An RTX 5080 owner ran 21 community quantizations of Qwen3.8-27B on their own C codebase, ranking by mean KL divergence and same-top-p agreement rather than a public benchmark. bartowski/Qwen3.8-27B-IQ4_XS won overall, with huihui-ai's abliterated UD-IQ4_XS the best uncensored option and jpetrina's IQ4_XS-pure the choice when you need more context headroom. The bottom of the table is the useful part: a QAT q2_0 at 8.2GiB carries a 0.89 mean KLD and only 85.7% top-p agreement, so the cheapest quants are far worse than their file size suggests.