A builder with 768GB of VRAM is asking whether local frontier hardware is already obsolete
r/LocalLLaMA·low signal
An Epyc owner running twelve 64GB cards plus 256GB of system RAM posted that the only open frontier model that still fits is GLM-5.3, and that upcoming releases including GLM 6 look likely to be two trillion parameters or more (211 upvotes, 214 comments). A parallel thread asking whether to spend $15k on a home server now or wait drew 230 comments and the poster edited in a decision to wait. Read alongside AMD's 576GB Halo Station pitch, the local-inference ceiling is now set by model size growing faster than consumer memory, not by bandwidth.