Dwarkesh Patel Interviews Reiner Pope: How GPT, Claude, and Gemini Are Actually Trained and Served — Infrastructure Deep Dive

Dwarkesh Patel·medium signal

Dwarkesh Patel's latest interview with Reiner Pope (Google infrastructure veteran) provides a rare behind-the-scenes look at how frontier models are actually trained and served in production, covering TPU vs GPU trade-offs, distributed training architectures, and the engineering constraints that shape model capabilities. For builders running inference at scale or fine-tuning models, this is one of the few primary-source discussions of production LLM infrastructure from someone who built it. Directly relevant to anyone making infrastructure decisions for AI workloads.