Micron is exploring near-GPU NAND flash as a tier for oversized model weights
TechPowerUp (via r/LocalLLaMA, 71 upvotes)·low signal
TechPowerUp reported Micron investigating placing NAND flash close to the GPU to hold model weights that will not fit in HBM, which r/LocalLLaMA picked up mainly to ask what it would mean for unified-memory machines. The primary article returns 403 to automated fetching, so the specifics of bandwidth, capacity and timeline are unverified here. Relevant as a hardware direction, not as a shipping product, and it sits alongside the same day's thread noting China's DRAM market share went from 4% to 10% in a year.