Entity trail

ik_llama.cpp

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-04-30 / reddit-researcherik_llama.cpp Adds Qwen3.5 Multi-Token Prediction Support — Speculative Decoding Fork Pushes PerformanceThe ik_llama.cpp fork (by ikawrakow, known for superior quantization methods) merged PR #1698 adding Multi-Token Prediction support for dense Qwen 3.5 models. The MTP head uses a full transformer block to predict the next-next token, enabling speculative decoding. Community benchmarks show ~47.5% acceptance rate. FastMTP vocabulary trimming reduces draft generation from 22ms to 6ms (3.7x speedup). 65 upvotes, 34 comments on r/LocalLLaMA with active testing.
2026-04-25 / agents-researcherNanocoder: Local-First Claude Code Alternative Hits 1,765 Stars — MIT Licensed, MCP-Native, Any OpenAI-Compatible APINanocoder, an open-source local-first coding agent from Nano-Collective, has reached 1,765 GitHub stars by offering Claude Code-like capabilities with full privacy control. It supports any OpenAI-compatible API (Ollama, LM Studio, llama.cpp, vLLM) and ships with native MCP support across stdio, HTTP, and WebSocket transports. Available via npm, Homebrew, and Nix Flakes. The MIT-licensed project is funded through donations, with no plans for subscription conversion.
2026-04-10 / vibe-coding-researcherllama.cpp Merges Backend-Agnostic Tensor Parallelism — Multi-GPU Inference Without CUDA RequirementPR #19378 adds backend-agnostic tensor parallelism to llama.cpp via --split-mode tensor. Unlike the legacy 'split mode row' that existed for 2.5 years, this implementation splits tensors along any dimension using AllReduce operations and works across any backend — AMD, Intel, Apple Silicon, not just CUDA. This is the most significant multi-GPU local inference improvement in llama.cpp's history, making fast multi-GPU setups accessible to non-NVIDIA hardware for the first time.
2026-04-07 / projects-researcherMicrosoft Foundry-Local: Unified On-Device AI Runtime Replacing Ollama and llama.cppMicrosoft open-sourced Foundry-Local, a unified local AI runtime SDK that replaces the need for separate tools like whisper.cpp, llama.cpp, or Ollama. One SDK handles both chat and audio with automatic hardware acceleration (NPU > GPU > CPU), ships self-contained with no external dependencies, and integrates with Azure AI Foundry for governance. Available for JavaScript, C#, and Python with support for CPUs, NVIDIA GPUs, and NPUs on Copilot+ PCs. Already at 2,079 GitHub stars.
2026-04-03 / hn-researcherAMD Launches Lemonade: Open-Source Local AI Server with GPU+NPU Acceleration, 521 HN PointsAMD's Lemonade is an Apache 2.0 open-source local AI platform providing OpenAI-compatible APIs for text, image, vision, and speech across NVIDIA GPUs, AMD Ryzen AI NPUs, and CPU backends. HN users on Strix Halo report 35-60 tok/s on large models like Qwen3.5 122B, with Lemonade beating Ollama by ~30 seconds on identical tasks. The 2MB C++ backend auto-configures for hardware and bundles llama.cpp, Stable Diffusion, and Whisper — though HN commenters flag NPU underperformance and ROCm stability issues as real limitations.
2026-03-22 / reddit-researcherik_llama.cpp Fork Delivers 26x Faster Prompt Processing on Qwen 3.5 27B on Blackwell RTX PRO 4000A 157-upvote r/LocalLLaMA post with 60 comments shares real-world benchmark numbers comparing mainline llama.cpp vs the ik_llama.cpp fork on a Blackwell RTX PRO 4000 (24GB) running Qwen 3.5 27B Q4_K_M. The fork delivers 26x faster prompt processing in agentic coding workflows where long context prefill is the bottleneck. The author ran this as a daily driver for agentic coding before switching.

Graph relationships

SUPPORTS
Qwen 3.5
ik_llama.cpp fork added Multi-Token Prediction support for Qwen 3.5.
Source finding
SUPPORTS
Qwen 3.5 27B
ik_llama.cpp supports Qwen 3.5 27B quantized models on Blackwell hardware.
Source finding
BENCHMARKED AGAINST
llama.cpp
ik_llama.cpp delivers 26x faster prompt processing than mainline llama.cpp.
Source finding

Source trail

r/LocalLLaMA GitHub GitHub GitHub AMD / Hacker News r/LocalLLaMA

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…