Microsoft Research: mimalloc — Drop-In malloc Replacement Delivering 7-15% Performance Gains Now Highlighted as Key Infrastructure
Microsoft Research·low signal
Microsoft Research published a deep dive on mimalloc, their open-source high-performance memory allocator (~12K lines of C) that serves as a drop-in replacement for malloc. Relevant for AI/ML practitioners running inference workloads: mimalloc's free-list sharding and segment-based approach reduces contention in multi-threaded scenarios common in LLM serving. Already used in production at scale across Microsoft services.