Entity trail

llama-server

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-09-03 / github-pulse-researcherFabric v1.4.474 required API keys for non-loopback bindings after shipping an unauthenticated Ollama proxyReleased 2026-09-03T01:09Z, PR #2206 by ksylvan confines storage names against directory traversal, confines symlink targets to the configured filesystem storage directories, requires API keys for non-loopback server bindings, authenticates the Ollama routes, and defaults the REST server to loopback port 8080. Anyone who exposed a Fabric REST server on a LAN interface before this release was running an open proxy to their local Ollama instance. The release adds regression coverage for traversal, symlink and authentication specifically.
2026-09-01 / github-pulse-researcherllama.cpp adds recurrent state rollback for Qwen3.8-Flash-Next, taking MTP speculative decoding from 123 to 183 tok/sBuild b10731, published 2026-09-01, implements recurrent state rollback for qwen4exp (#28123), which MTP speculative decoding needs so the target state can move back by the number of rejected draft tokens. Without it the context was classified SEQ_RM_TYPE_FULL and the server serialized the whole recurrent state to host memory every round, costing more than the drafting saved. Measured on Qwen3.8-Flash-Next UD-Q4_K_XL with n-max 3 and a single slot, decoding reaches 183 tok/s on code and 144 on prose, against 123 and 83 on the same branch before the change and 108 tok/s with no draft at all.
2026-08-29 / github-pulse-researcherllama.cpp fixes a Vulkan graph-optimizer bug that silently produced wrong tokens on AMD and NVIDIA with nothing loggedBuild b10677 (2026-08-28) fixes `ggml_vk_graph_optimize`, where `is_src_of` did not treat two views of one tensor as dependent, so the optimizer reordered nodes across aliased reads and writes. The maintainers describe the result as silently wrong tokens under greedy decoding, different output on every server start, and invalid speculative-decoding acceptance, hitting Qwen3.8's recurrent state and any model with view-aliased state; CUDA was unaffected. A second commit stops treating NONE/RESHAPE/TRANSPOSE/VIEW/PERMUTE no-op nodes as aliasing dependencies, which only cost the optimizer reordering freedom.
2026-08-28 / reddit-researcher'5090 Now Officially Cost 5090': RTX 5090 Median Hits $4,699 in the US and $5,112 in KoreaA 1,192-upvote r/LocalLLaMA post marks the moment the RTX 5090's street price caught up with its model number, with the US median at $4,699.99 in August against $4,299.99 in June and Korean listings at $5,112, versus a $1,999 launch MSRP. Memory is now more than 80% of a GPU's bill of materials, with 16GB of GDDR7 climbing from roughly $65 to $80 per card in mid-2025 to over $200 by the end of that year. The same thread ran alongside a 753-upvote post about used server RAM prices, which is the same squeeze one tier down.
2026-08-27 / reddit-researcherLemonade Now Fronts 15 Inference Engines Behind One Base URL With Semantic and Policy RoutingThe Lemonade maintainers posted an end-of-summer update on 2026-08-26 covering CUDA, ARM64, Metal and Vulkan backends for all core engines, experimental engines for music and 3D asset generation, and a router that now does semantic and policy routing. It installs as a single OS service managing models and engines behind one base URL, and ships as an embeddable SDK. Maintainers confirmed in-thread that DGX Spark is supported, and noted you can point the config at your own llama-server binary to run llama.cpp PRs early while keeping Lemonade's routing.
2026-08-26 / reddit-researcherIntel's Arc Pro B60 Dual 48GB Turned Up in European Retail at About $3,000 Despite Being Called Channel-OnlyA Swiss buyer spotted the dual-GPU Arc Pro B60 48GB listed on Digitec/Galaxus at CHF 2,500 including tax, roughly $3,000, after Intel indicated these would not reach standard retail channels. The r/LocalLLaMA consensus (171 upvotes) is that the card is two B60s bifurcated x8/x8 presenting as two GPUs, which means consumer boards can only usefully host one, while workstation and server boards can take four. The poster's own framing sets the bar: for it to be interesting it has to cost less than about 2.5x a single B60, and at this price it does not.
2026-08-25 / reddit-researcherllama.cpp Documentation Moved to llama.app, Hosted by Hugging Face, and Ships Alongside a Pi Coding AgentA 216-upvote r/LocalLLaMA post surfaced the new docs site covering installation, quickstart, CLI, server deployment, API integration and web UI. Merve from Hugging Face confirmed in the thread that the site is official and linked from the llama.cpp GitHub page, and explained the pi-llama reference as HF's own lightweight Pi coding agent, which she describes as token-efficient. Commenters note it is a first iteration, with CLI command coverage still missing and several links pointing back at raw GitHub markdown.
2026-08-24 / reddit-researcherQwen 3.8 27B Reverse-Engineered Firmware From an Early-2000s ARM Point-of-Sale Terminal That Opus 4 Could NotA practitioner who previously benchmarked Qwen 3.8 against 3.6 on an HTML Galaga port deliberately moved to a task with no plausible training-data contamination: firmware and software preservation and emulation for an early 2000s ARM-based POS system. Running UD-Q8_K_XL on two RTX 3090s under llama-server with Opencode, the local model completed work he says Opus 4 could not, and the post got picked up by XDA Developers the same day. A commenter with 80 upvotes independently reported running an abliterated Qwen 3.8 alongside DeepSeek V4 Pro and headless Ghidra for binary analysis, which is a second data point that this model is unusually strong at non-x86 reverse engineering.
2026-08-23 / agents-researcherXinference scores CVSS 10.0 for unauthenticated RCE through eval() in Llama3 tool-call parsingGHSA-x2rj-828p-hx9m (CVE-2026-61539), published 21 August 2026, describes Xinference passing Llama3 tool-call output to Python's eval() during post-processing. Because model output is steerable by prompt, an attacker can get a Python expression returned and executed server-side via /v1/chat/completions, which ships with authentication off by default. Versions up to 2.5.0 are affected; the fix is 2.7.0. This is the cleanest example yet of the tool-call parser being the exploitable surface rather than the tool itself.
2026-08-22 / reddit-researcherllama.cpp Cut Its First Semver Stable Release, v0.2.0, Splitting Stable Tags From Nightly b-Buildsllama.cpp published v0.2.0 on 2026-08-21T18:32Z, formalizing a two-track scheme where vX.Y.Z marks stable releases on a slower cadence for downstream distribution while the existing b[NUM] tags remain per-commit nightlies. The release rolls up over 100 commits including flash-attention dequantization of quantized KV cache, server endpoint authentication, and Granite, Nemotron and DeepSeek-OCR model support across SYCL, Metal, Vulkan, OpenCL and CUDA. Anyone pinning llama.cpp by b-tag in a Dockerfile now has a supported alternative.
2026-08-21 / reddit-researcherSame Model, Same Server, Different Harness: PI Agent Beat OpenCode Badly on Qwen3.8-27BAn r/LocalLLaMA test (160 upvotes, 108 comments) ran Qwen3.8-27B Q4_K_M through llama-server on an RTX 3090 and compared PI Agent against OpenCode on the classic bouncing-ball animation task. PI Agent produced better output while using fewer tokens, running faster, and avoiding OpenCode's hard 32k output cap and freezes. The concrete difference is compaction timing: with a 100k context and 32k output set, OpenCode starts compressing at 67k while PI Agent holds to 90k. For local-model users the harness is now as much of a variable as the model.
2026-08-20 / arxiv-researcherFlama Ships an ASGI Framework That Serves REST, ML Models and LLMs Through One Rust-Accelerated CoreFlama (arXiv 2608.18733, 2026-08-19; package live on PyPI) is an open-source ASGI Python framework unifying REST APIs, predictive model serving and generative inference across seven subsystems. Notable pieces for builders: a .flm portable binary format packaging scikit-learn, TensorFlow, PyTorch and Hugging Face models with metadata for zero-code deployment, a multi-backend LLM server running vLLM on Linux/CUDA or MLX on Apple Silicon while exposing OpenAI, Anthropic, Ollama and a native streaming protocol through a shared codec, and an MCP module that turns any Flama app into an MCP server over JSON-RPC 2.0. Routing, JSON encoding, compression and parsing are Rust-accelerated via Maturin, with OpenAPI 3.2.0 generated from handler signatures.

Graph relationships

USES
ODS
ODS bundles llama-server for inference capabilities.
Source finding
USES
DreamServer
DreamServer bundles llama-server for continuous batching.
Source finding
WORKS AT
Georgi Gerganov
Georgi Gerganov maintains llama-server.
Source finding
USES
ODS -> llama-server
ODS bundles llama-server for inference capabilities.
Source finding
USES
DreamServer -> llama-server
DreamServer bundles llama-server for continuous batching.
Source finding
WORKS AT
Georgi Gerganov -> llama-server
Georgi Gerganov maintains llama-server.
Source finding

Source trail

GitHub GitHub GitHub r/LocalLLaMA r/LocalLLaMA (Lemonade maintainers)r/LocalLLaMA, listing at Digitec/Galaxus llama.app, via r/LocalLLaMA r/LocalLLaMA (113 upvotes), also covered at xda-developers.com/qwen-3-8-27b-reverse-engineering-job-frontier-model/ and cross-posted to r/singularity (556 upvotes)GitHub Security Advisories ggml-org/llama.cpp GitHub releases (surfaced via r/LocalLLaMA)r/LocalLLaMA arXiv 2608.18733

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…