Reddit
$500 Nvidia V100 32GB Achieves 115 Tokens/Second on Qwen Coder 30B A3B Q5
A practitioner demonstrates that a secondhand V100 32GB purchased for ~$500 including shipping achieves 115 tokens/second on Qwen Coder 30B A3B Q5, despite the card having no ongoing consumer driver support. The 143-upvote post with 72 comments highlights the continued viability of the data center GPU surplus market for affordable high-VRAM inference, with the V100's 32GB HBM2 being the key advantage over consumer RTX cards at this price point. The result positions the V100 as an undervalued local inference platform.
Source
↳ Follow the thread