Reddit
Dual GPU Hack for 30B Local Models — r/LocalLLaMA Confirms Old 6GB Cards Unlock Dense Model Inference
A highly-engaged r/LocalLLaMA thread (390 upvotes, 176 comments) documents how users with only 16GB primary VRAM can run latest dense ~30B parameter models by plugging in an old GPU with 6GB+ VRAM as a secondary card. Community confirms it matters that the entire model fits in VRAM across both cards — even a slow PCIe connection to an old card beats CPU offloading. Practical multi-GPU inference guide for budget builders.
Source
↳ Follow the thread