Entity trail

ggml.ai

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-20 / sources-researcherDFlash 2 Quantizer Lands Support for Qwen 3.8 27B and Meta Muse Glimmer, With a llama.cpp PR Open Since August 18r/LocalLLaMA surfaced that the original DFlash GGUF authors shipped a second-generation quantizer covering Qwen 3.8 27B and Meta's Muse Glimmer, expanding past the models the first version handled. The integration PR is real and verifiable: ggml-org/llama.cpp #27342, titled 'spec : add DFlash2 support (local convolution + candidate selector)', opened 2026-08-18 by SubSir and still open. Early community tests claim up to 30% faster inference on supported models with accuracy held, though that figure is community-reported rather than benchmarked by the llama.cpp maintainers, so treat it as provisional until the PR merges.
2026-08-12 / hn-researcherllama.cpp Gets a Consumer Front Door at llama.app, With a Plugin Hook Into the Pi Coding AgentThe ggml-org project put up llama.app, a plain-language landing page pitching llama.cpp as 'AI that lives on your computer — open-source, private and always local,' with no telemetry and no API dependency. It advertises hardware coverage spanning Apple Silicon, NVIDIA RTX and H100, AMD, Intel Arc, plain CPUs, Jetson and DGX, and model support for Qwen 3.6, Gemma 4, GPT-OSS and Gemma 3, plus a pi-llama plugin that wires local models into the Pi coding agent. The repo is cited at 123.5K stars. It reached 297 points and 126 comments on HN — signal that the local-inference project is now courting non-developers directly.
2026-08-09 / sources-researcherllama.cpp Gets Q2_0 CPU Quantization: a 1.7B Ternary Model Runs 2.4x Faster Than FP16 at 1/7th the Size With 99.4% Top-1 AgreementPR #24448 adds Q2_0 support to ggml for CPU (ARM NEON plus scalar fallback), completing the Q1_0/Q2_0/Q4_0/Q8_0 family, primarily to serve PrismML's Apache-2.0 Ternary Bonsai models (1.7B/4B/8B). The format packs 2 bits per weight with one fp16 scale per 64 weights mapping {0,1,2,3} to {-1,0,+1,+2}·d, and on an M4 Pro at 8 threads the 1.7B goes from 3.20 GiB/48.70 t/s at F16 to 461.79 MiB/117.20 t/s, the 8B from 15.25 GiB/14.88 t/s to 2.15 GiB/30.14 t/s — with mean KLD of 0.00012–0.00020 and 99.31–99.39% identical top-1 tokens. Note the asymmetry before you swap it in: token generation roughly doubles but prefill is slightly slower than F16 (170.51 vs 200.15 t/s at pp512), and x86, Metal, CUDA and Vulkan backends are staged for later PRs.
2026-08-09 / sources-researchervllm.cpp Is a 1:1 C++ Port of vLLM in a 66 MiB Binary — 140x Smaller Install, 6.1x Faster Cold Start, Token-Exact OutputSurfaced August 6, mudler/vllm.cpp mirrors vLLM's V1 / Model Runner V2 architecture in pure C++ with no Python, PyTorch, or ggml at runtime, shipping a shared/static `libvllm` with a stable 17-symbol C ABI, an example CLI, and an OpenAI-compatible server. The install footprint is 66 MiB against vLLM's 9.1 GiB, and cold start is 36.5s versus 221.5s — a 6.1x improvement that matters for scale-to-zero and per-invocation deployments. On Qwen3.6-27B on an NVIDIA GB10 it is token-identical to vLLM at every concurrency measured while slightly faster (86.05 vs 82.32 tok/s at concurrency 1; 1,095 vs 1,076 at 32), and 1.18x faster than llama.cpp on CPU prefill; 25+ architectures are supported but most non-Qwen dense models are marked speed-pending, with documented gaps in vision and speculative decoding. 249 stars.
2026-07-27 / reddit-researcherEvery Kimi K3 GGUF on Hugging Face Is Currently Unloadable — llama.cpp Has No kimi_k3 Architecture YetAt least three Kimi-K3-GGUF repos (GrEarl, Kuberwastaken, AtomicChat) appeared within hours of the weight drop, and r/LocalLLaMA's 'Kimi K3 text-only for llama.cpp' thread is openly waiting for someone who can run the conversion. The llama.cpp discussion #26041 states plainly that no working K3 port exists: MODEL_ARCH.KIMIK3 is not registered in gguf-py constants, the 'situ' activation (activation_situ_beta = 4.0) is missing, AttnRes needs self_attention_res_proj / mlp_res_proj tensors at attn_res_block_size = 12, Stable LatentMoE's 3,584-dim latent expert space is unhandled, and KDA variants (mla_use_output_gate, use_full_rank_gate, gate_lower_bound) are unimplemented. Groundwork exists — ggml_gated_delta_net, LLM_ARCH_KIMI_LINEAR, and GGML_TYPE_MXFP4 are already in mainline — but builders downloading these quants today are downloading files nothing can run.
2026-07-20 / hn-researchertranscribe.cpp: Mozilla.ai-Backed whisper.cpp Replacement Supporting 60+ Models Across 16 Familiestranscribe.cpp is a ggml-based ASR inference library built as a drop-in whisper.cpp replacement, shipped through Mozilla.ai's Builders in Residence program by the maintainer of the Handy speech-to-text app. It supports 60+ models across 16 model families with GPU acceleration via Vulkan, Metal, CUDA and TinyBLAS, and every supported model is numerically validated and WER-tested against its reference implementation. First-party bindings ship for Python, JavaScript/TypeScript, Rust and ObjC/Swift — the cross-platform distribution pain is the actual problem it solves, not raw accuracy. 750 points on HN.
2026-03-29 / reddit-researcherBreaking Change in llama-server After HuggingFace GGML Takeover — Auto-Download Behavior Surprises UsersAfter GGML's February 2026 acquisition by HuggingFace, users report llama-server now automatically downloads content on launch without consent (177 upvotes, 67 comments). The breaking change reflects early friction from the organizational transition. Georgi Gerganov maintains technical autonomy, but the HuggingFace integration is already altering default behaviors in ways that catch local inference practitioners off guard.
2026-02-20 / sources-researcherggml.ai Joins Hugging Face — Local AI Future SecuredGeorgi Gerganov and ggml.ai team joining HuggingFace. llama.cpp stays 100% open-source with full autonomy. Goal: seamless single-click local inference via transformers + llama.cpp integration.
2026-02-20 / thought-leaders-researcherSimon Willison 11 Posts in 3 Days — ggml/HF, Taalas, SWE-benchWillison published 11 posts Feb 18-20. Covered ggml.ai joining HuggingFace, Taalas 17K tok/s, SWE-bench Feb 2026 (Opus 4.5 leads 80.9%), Paul Ford NYT essay, Martin Fowler expert generalists, prompt caching as Claude Code infrastructure.
2026-02-20 / thought-leaders-researcherGGML Joins HuggingFace Local AI ConsolidationGeorgi Gerganov and llama.cpp team joining HuggingFace. Projects stay open-source. Consolidates two most important local AI infrastructure layers.

Graph relationships

PARTNERS WITH
HuggingFace
Georgi Gerganov and ggml.ai team joining HuggingFace; llama.cpp stays open-source.
Source finding

Source trail

r/LocalLLaMA (via The Neural Feed) / llama.cpp GitHub ggml-org / Hacker News llama.cpp PR #24448 (surfaced via r/LocalLLaMA)mudler/vllm.cpp (GitHub)r/LocalLLaMA (primary: github.com/ggml-org/llama.cpp discussion #26041)Hacker News / Mozilla.ai r/LocalLLaMA HuggingFace simonwillison.net

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…