DualPath: DeepSeek Solves Agentic Inference Bottleneck (arXiv)

DeepSeek-AI with Peking/Tsinghua addresses storage bandwidth bottleneck in multi-turn agentic LLM inference. In disaggregated architectures, KV-Cache loading creates asymmetric bandwidth saturation. DualPath enables dual-path loading via RDMA: 1.87x offline throughput, 1.96x online serving improvement. If running agentic workloads with long context, this architecture directly addresses the cost problem.