Lumabri Runs Huge MoE Models Across a P2P Swarm by Shipping 4KB Activations Instead of Expert Weights

GitHub / Hacker News·medium signalXBlueskyLinkedInCopy link

Lumabri, a pure-C Apache-2.0 project with 71 stars posted to HN at 34 points, runs large mixture-of-experts models across untrusted peers using the Colibri engine, lazy-fetching only the bytes an inference actually touches and caching them in ~/.lumabri for full-speed reuse. Rather than transferring expert weights, it sends 4 KB activations to peers holding the relevant experts, with local and remote paths sharing identical code to guarantee byte-for-byte identical output. Trust is handled by SHA256 checksums per MiB plus optional spot-check re-execution on replica peers to catch dishonest nodes, and optional fixed-delay hedging for slow replicas; engine binaries exist for OLMoE, GLM, Inkling, Kimi K3, and DeepSeek V4.