H100 GPU Prices Melting UP: Memory Shortage and AI Demand Reverse the Decline
Latent Space·medium signal
Latent Space reports H100 rental prices have reversed their 2-year decline, with hourly rates climbing from $2.00 to $2.20 (10% jump) in a 4-week span. The reversal is driven by DRAM/HBM shortages ('RAMmageddon'), AI inference demand outpacing supply, and AMD forecasting ~10% GPU price hikes in 2026 specifically due to memory cost pressure. Current cloud rental median is $2.29/hr, but ranges wildly from $0.94 to $14.90/hr across providers. For builders, this means infrastructure costs are rising, not falling.