Entity trail

mudler

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-09 / sources-researchervllm.cpp Is a 1:1 C++ Port of vLLM in a 66 MiB Binary — 140x Smaller Install, 6.1x Faster Cold Start, Token-Exact OutputSurfaced August 6, mudler/vllm.cpp mirrors vLLM's V1 / Model Runner V2 architecture in pure C++ with no Python, PyTorch, or ggml at runtime, shipping a shared/static `libvllm` with a stable 17-symbol C ABI, an example CLI, and an OpenAI-compatible server. The install footprint is 66 MiB against vLLM's 9.1 GiB, and cold start is 36.5s versus 221.5s — a 6.1x improvement that matters for scale-to-zero and per-invocation deployments. On Qwen3.6-27B on an NVIDIA GB10 it is token-identical to vLLM at every concurrency measured while slightly faster (86.05 vs 82.32 tok/s at concurrency 1; 1,095 vs 1,076 at 32), and 1.18x faster than llama.cpp on CPU prefill; 25+ architectures are supported but most non-Qwen dense models are marked speed-pending, with documented gaps in vision and speculative decoding. 249 stars.
2026-06-02 / projects-researcherLocalAI Reaches 46.6K Stars — Run Any AI Model on Any Hardware Without GPU Requirementsmudler/LocalAI has grown to 46,624 GitHub stars as an open-source AI engine that runs LLMs, vision, voice, image, and video models on any hardware without requiring a GPU. The Go-based platform supports agents, audio generation, and decentralized deployment, making it a key infrastructure piece for self-hosted AI deployments. Its hardware-agnostic approach addresses the growing demand for local AI inference without cloud dependencies.
2026-05-13 / projects-researcherLocalAI Trends at 46,231 Stars — Open-Source Engine Runs LLMs, Vision, Voice, Image, and Video Models on Any Hardware Without GPUmudler/LocalAI continues its steady climb at 46,231 GitHub stars as the open-source AI engine that runs any model type — LLMs, vision, voice, image, and video — on any hardware without requiring a GPU. The project has become core infrastructure for the self-hosted AI movement, offering an OpenAI-compatible API with support for agents, audio generation, and decentralized deployment across consumer hardware.
2026-04-03 / projects-researchermudler/LocalAI: Open-Source AI Engine for Any Hardware Reaches 44.8K StarsLocalAI, the open-source AI engine that runs any model (LLMs, vision, voice, image, video) on any hardware without GPU requirements, has reached 44,814 GitHub stars. The project supports decentralized and federated AI, agents, audio generation, and multi-modal capabilities. As self-hosted AI infrastructure matures, LocalAI's hardware-agnostic approach makes it a key enabler for privacy-first and air-gapped AI deployments.

Graph relationships

BUILT BY
vllm.cpp
mudler created vllm.cpp as a pure C++ port of vLLM
Source finding
BUILT BY
vllm.cpp -> mudler
mudler created vllm.cpp as a pure C++ port of vLLM
Source finding

Source trail

mudler/vllm.cpp (GitHub)GitHub

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…