Fetching from the wire…
Vibe Coding2026-07-25 · source-backed
A llama.cpp fork by fewtarius aimed at AMD APUs, iGPUs and handhelds adds a persistent SSD-backed KV cache with hot/warm/cold tiering. On an Ayaneo Flip KB running Qwen3.6-35B over a 15,700-token prompt, cold TTFT was 143.1 seconds versus 0.99 seconds warm, a 144.5x speedup. Also adds system-prompt caching across conversations, hybrid MoE checkpoint restoration, MoE expert-activation tracking, per-user concurrency caps, and Vulkan tuning for Strix Halo. MIT, 101 stars. This targets the exact pathology of local agent loops: re-evaluating thousands of tokens of system prompt and tool definitions on hardware generating 5-20 tok/s.
Each link below shares sources, entities, or timing with this story.
DGX Spark benchmarked against Strix Halo / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (DGX Spark benchmarked against Strix Halo); both cover Strix Halo, Vulkan; overlapping topics (agentic, prompt, token).
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover MoE, Qwen3; reported by the same outlet (github.com); overlapping topics (agent, agentic).
Shared entities / Shared topic / Earlier coverage / Tension
Both cover MoE, Qwen3; overlapping topics (agent, agentic); earlier MoE coverage from 2026-04-21.
DGX Spark benchmarked against Strix Halo / Shared entity: Qwen3 / Same source domain / Earlier coverage
Linked by a graph relationship (DGX Spark benchmarked against Strix Halo); both cover Qwen3; reported by the same outlet (github.com).
Shared entities / Earlier coverage
Both cover MoE, Qwen3, TTFT; earlier MoE coverage from 2026-07-24.
Shared entity: MoE / Same source domain / Shared topic / Earlier coverage
Both cover MoE; reported by the same outlet (github.com); overlapping topics (cache, caching, token).
Shared entity: Qwen3 / Same source domain / Shared topic / Earlier coverage
Both cover Qwen3; reported by the same outlet (github.com); overlapping topics (agent, agentic, token).
Shared entities / Shared topic / Earlier coverage
Both cover MIT, MoE; overlapping topics (agent, agentic); earlier MIT coverage from 2026-07-01.