Qwen3.6 27B FP8 Achieves 80 TPS with 200K Token Context on Single RTX 5000 PRO 48GB

r/LocalLLaMA·medium signal

A practitioner demonstrates that Qwen3.6 27B in FP8 runs with 200K tokens of BF16 KV cache at 80 tokens per second on a single RTX 5000 PRO 48GB — without any quantization tricks on the KV cache. The post (78 upvotes, 82 comments on r/LocalLLaMA) argues this makes aggressive KV-cache quantization less necessary for users willing to invest in 48GB cards, reframing the local inference conversation around 'just buy more VRAM' vs compression engineering.