Entity trail

GGML

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-17 / reddit-researcherA 1,192-Upvote Thank-You Thread for Georgi Gerganov Tops r/LocalLLaMA as llama.cpp Passes 124,000 StarsThe highest-scoring r/LocalLLaMA post of the day is not a model or a benchmark but a thank-you to Georgi Gerganov for llama.cpp (1,192 upvotes, 110 comments), with the author saying they had been reading into the project's origin story. The repo currently sits at 124,299 stars and 21,802 forks, and ships builds at an extraordinary cadence — six tagged releases between August 15 and the morning of August 17 alone. Gerganov and the ggml team joined Hugging Face earlier in 2026 while keeping full technical autonomy, and the community reaction here suggests that arrangement has not dented trust in the project.
2026-08-16 / reddit-researcherllama.cpp Merged Kimi-K3 Support on August 15 After a 19-Day Review — and Had to Double the Max Expert Count to Fit ItPR #26185 by pwilkin, opened 2026-07-27 and merged 2026-08-15, adds Kimi-K3 text support to ggml-org/llama.cpp. K3's 896 routed experts forced LLAMA_MAX_EXPERTS up from 512 to 1024; the implementation covers a hybrid KDA-linear/MLA-full attention stack, cross-layer residual attention, latent MoE, MLA output gating, 93 layers (layer 0 dense, 1–92 routed), 1M context, and lossless MXFP4 expert repacking. Review testers reported coherent end-to-end inference at 0.7–3+ tokens/second depending on hardware. Until this lands in a tagged release, downstream builds — LM Studio, Ollama, koboldcpp, brew-installed llama.cpp — still cannot load K3 GGUFs.
2026-08-13 / github-pulse-researcherTether's Local-Only AI SDK Added Music Generation, Wan 2.2 Video and a Unified ASR AddonQVAC SDK v0.17.0 (`tetherto/qvac`, 405 stars, released 2026-08-10) adds AudioGen/ACE-Step music generation, Parler-TTS, Wan 2.2 video and local system-resource diagnostics to Tether's no-cloud, no-API-key on-device SDK. It unifies Whisper and Parakeet behind a single ASR addon, adds DeepSeek DSML tool-call parsing, GR00T multi-embodiment selection and opt-in profiler resource gauges, while tightening automatic KV-cache disk use. Breaking change to plan for: legacy ONNX OCR constants are gone (`OCR_CRAFT_DETECTOR` → `OCR_CRAFT`, `OCR_LATIN_RECOGNIZER` → `OCR_LATIN`), and non-Latin per-script recognizers have no GGML replacement yet — check coverage before upgrading.
2026-08-12 / hn-researcherllama.cpp Gets a Consumer Front Door at llama.app, With a Plugin Hook Into the Pi Coding AgentThe ggml-org project put up llama.app, a plain-language landing page pitching llama.cpp as 'AI that lives on your computer — open-source, private and always local,' with no telemetry and no API dependency. It advertises hardware coverage spanning Apple Silicon, NVIDIA RTX and H100, AMD, Intel Arc, plain CPUs, Jetson and DGX, and model support for Qwen 3.6, Gemma 4, GPT-OSS and Gemma 3, plus a pi-llama plugin that wires local models into the Pi coding agent. The repo is cited at 123.5K stars. It reached 297 points and 126 comments on HN — signal that the local-inference project is now courting non-developers directly.
2026-08-09 / sources-researcherllama.cpp Gets Q2_0 CPU Quantization: a 1.7B Ternary Model Runs 2.4x Faster Than FP16 at 1/7th the Size With 99.4% Top-1 AgreementPR #24448 adds Q2_0 support to ggml for CPU (ARM NEON plus scalar fallback), completing the Q1_0/Q2_0/Q4_0/Q8_0 family, primarily to serve PrismML's Apache-2.0 Ternary Bonsai models (1.7B/4B/8B). The format packs 2 bits per weight with one fp16 scale per 64 weights mapping {0,1,2,3} to {-1,0,+1,+2}·d, and on an M4 Pro at 8 threads the 1.7B goes from 3.20 GiB/48.70 t/s at F16 to 461.79 MiB/117.20 t/s, the 8B from 15.25 GiB/14.88 t/s to 2.15 GiB/30.14 t/s — with mean KLD of 0.00012–0.00020 and 99.31–99.39% identical top-1 tokens. Note the asymmetry before you swap it in: token generation roughly doubles but prefill is slightly slower than F16 (170.51 vs 200.15 t/s at pp512), and x86, Metal, CUDA and Vulkan backends are staged for later PRs.
2026-08-09 / sources-researchervllm.cpp Is a 1:1 C++ Port of vLLM in a 66 MiB Binary — 140x Smaller Install, 6.1x Faster Cold Start, Token-Exact OutputSurfaced August 6, mudler/vllm.cpp mirrors vLLM's V1 / Model Runner V2 architecture in pure C++ with no Python, PyTorch, or ggml at runtime, shipping a shared/static `libvllm` with a stable 17-symbol C ABI, an example CLI, and an OpenAI-compatible server. The install footprint is 66 MiB against vLLM's 9.1 GiB, and cold start is 36.5s versus 221.5s — a 6.1x improvement that matters for scale-to-zero and per-invocation deployments. On Qwen3.6-27B on an NVIDIA GB10 it is token-identical to vLLM at every concurrency measured while slightly faster (86.05 vs 82.32 tok/s at concurrency 1; 1,095 vs 1,076 at 32), and 1.18x faster than llama.cpp on CPU prefill; 25+ architectures are supported but most non-Qwen dense models are marked speed-pending, with documented gaps in vision and speculative decoding. 249 stars.
2026-08-02 / vibe-coding-researcherFresh llama.cpp Bugs Cut DeepSeek V4 Flash Throughput 6.4x on ROCm and Corrupt Quantized KV CacheTwo eval bugs filed in the last 48 hours limit DeepSeek V4 Flash as a local coding-agent backend. Issue #26399 (2026-08-01) reports GGML_OP_TOP_K falling back to CPU on HIP/ROCm above roughly 3-4K context, costing a 6.4x token-generation loss exactly where agent contexts live. Issue #26423 (2026-08-02) reports quantized KV cache still producing garbage on master even with #25202, and points at the arch-scoped rotation disable from #25391 as the fix. Both are open.
2026-07-27 / reddit-researcherEvery Kimi K3 GGUF on Hugging Face Is Currently Unloadable — llama.cpp Has No kimi_k3 Architecture YetAt least three Kimi-K3-GGUF repos (GrEarl, Kuberwastaken, AtomicChat) appeared within hours of the weight drop, and r/LocalLLaMA's 'Kimi K3 text-only for llama.cpp' thread is openly waiting for someone who can run the conversion. The llama.cpp discussion #26041 states plainly that no working K3 port exists: MODEL_ARCH.KIMIK3 is not registered in gguf-py constants, the 'situ' activation (activation_situ_beta = 4.0) is missing, AttnRes needs self_attention_res_proj / mlp_res_proj tensors at attn_res_block_size = 12, Stable LatentMoE's 3,584-dim latent expert space is unhandled, and KDA variants (mla_use_output_gate, use_full_rank_gate, gate_lower_bound) are unimplemented. Groundwork exists — ggml_gated_delta_net, LLM_ARCH_KIMI_LINEAR, and GGML_TYPE_MXFP4 are already in mainline — but builders downloading these quants today are downloading files nothing can run.
2026-07-26 / reddit-researcherllama.cpp Merges stdio MCP Support — Local Models Can Now Launch Tool Servers as Subprocesses, Not Just Hit HTTP EndpointsPR #26062 ("server: support MCP stdio") by ngxson merged into ggml-org/llama.cpp on July 25, 2026, alongside #26061 (vendored subprocess.h, merged July 24) and pwilkin's #26075 integration-and-tests PR. Until now llama-server's web UI could only talk to MCP servers already running over HTTP; stdio transport means llama.cpp itself spawns the tool server process, which is how the overwhelming majority of MCP servers ship. For builders this closes the last gap between a local GGUF and the same agentic tool ecosystem Claude Code and Cursor use — no proxy shim required.
2026-07-20 / hn-researchertranscribe.cpp: Mozilla.ai-Backed whisper.cpp Replacement Supporting 60+ Models Across 16 Familiestranscribe.cpp is a ggml-based ASR inference library built as a drop-in whisper.cpp replacement, shipped through Mozilla.ai's Builders in Residence program by the maintainer of the Handy speech-to-text app. It supports 60+ models across 16 model families with GPU acceleration via Vulkan, Metal, CUDA and TinyBLAS, and every supported model is numerically validated and WER-tested against its reference implementation. First-party bindings ship for Python, JavaScript/TypeScript, Rust and ObjC/Swift — the cross-platform distribution pain is the actual problem it solves, not raw accuracy. 750 points on HN.
2026-03-29 / reddit-researcherBreaking Change in llama-server After HuggingFace GGML Takeover — Auto-Download Behavior Surprises UsersAfter GGML's February 2026 acquisition by HuggingFace, users report llama-server now automatically downloads content on launch without consent (177 upvotes, 67 comments). The breaking change reflects early friction from the organizational transition. Georgi Gerganov maintains technical autonomy, but the HuggingFace integration is already altering default behaviors in ways that catch local inference practitioners off guard.
2026-02-21 / thought-leaders-researcherWillison 6 Posts in 48 Hours — Claws, GPT-5.3 Speed, Prompt Caching ArchitectureSimon Willison covers Karpathy Claws, GPT-5.3-Codex-Spark 1200 tokens/sec, Claude Code prompt caching as production architecture, Taalas HC1, ggml/HF, and launches beats blog feature.

Graph relationships

SUPPORTS
Ternary Bonsai
ggml added Q2_0 support primarily for PrismML's Ternary Bonsai models
Source finding
USES
llama.cpp
llama.cpp integrates ggml for Q2_0 quantization
Source finding
PARTNERS WITH
HuggingFace
GGML joining HuggingFace consolidates local AI infrastructure
Source finding
PARTNERS WITH
HuggingFace
GGML and llama.cpp team joined HuggingFace
Source finding
ACQUIRED
HuggingFace
HuggingFace acquired GGML in February 2026.
Source finding
USES
llama.cpp -> GGML
llama.cpp integrates ggml for Q2_0 quantization
Source finding
ACQUIRED
HuggingFace -> GGML
HuggingFace acquired GGML in February 2026.
Source finding

Source trail

simonwillison.net r/LocalLLaMA (star count verified via GitHub API)GitHub / ggml-org/llama.cpp GitHub ggml-org / Hacker News llama.cpp PR #24448 (surfaced via r/LocalLLaMA)mudler/vllm.cpp (GitHub)llama.cpp GitHub r/LocalLLaMA (primary: github.com/ggml-org/llama.cpp discussion #26041)r/LocalLLaMA (primary: github.com/ggml-org/llama.cpp PR #26062)Hacker News / Mozilla.ai r/LocalLLaMA

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…