Hacker News
Antirez Builds ds4: DeepSeek V4 Flash Local Inference Engine for Mac Metal — 392 Points on HN
Salvatore Sanfilippo (antirez, creator of Redis) released ds4.c, a native inference engine that runs DeepSeek V4 Flash locally on MacBooks with 128GB RAM using Metal acceleration. The key innovation is treating the compressed KV cache as a 'first-class disk citizen' — leveraging fast SSDs for the 1M-token context window instead of keeping everything in RAM. Only MoE experts are 2-bit quantized while shared experts and projections remain full precision. Hit 392 points on HN.
↳ Follow the thread