Fetching from the wire…
Tools2026-09-09 · source-backed
Strix Halo and Strix Point default to Vulkan instead of ROCm for up to 23% faster prompt processing and 8% faster generation, and AMD iGPUs without ROCm move to Vulkan instead of CPU on Linux. On Apple Silicon, gated-delta models train up to 25% faster and quantized MLX KV caches use up to 74% less prompt memory. PyTorch moves 2.10 to 2.11, binaries are 50% smaller, the Python package is 44% smaller, and Windows llama-server.exe is now signed. GitHub
Each link below shares sources, entities, or timing with this story.
June local-inference benchmarks across the 128GB class put NVIDIA's DGX Spark (~$4k), AMD's Strix Halo / Ryzen AI Max+ 395 (~$2 to 3k), and the M5 Max 128GB (~$5k) head to head (Hardware Corner). Prompt processing favors CUDA hard. But token generation lands at a surprisingly...
+3,059 this week. Bundles Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox Multilingual, Chatterbox Turbo (350M), HumeAI TADA and Kokoro into one MIT-licensed local voice studio, with zero-shot cloning from audio samples plus 50+ preset voices across 23 languages, combining TTS...
mudler/vllm.cpp mirrors vLLM's V1 / Model Runner V2 architecture in pure C++ with no Python, PyTorch, or ggml at runtime, shipping a shared/static libvllm with a stable 17-symbol C ABI, an example CLI, and an OpenAI-compatible server. Install footprint 66 MiB against vLLM's 9....
Build b10677 fixes ggml_vk_graph_optimize, where is_src_of didn't treat two views of one tensor as dependent, so the optimizer reordered nodes across aliased reads and writes. Maintainers describe the result as silently wrong tokens under greedy decoding, different output on e...
Three moves, two days, no coordination between them. August 10–11: GitHub shipped Ollama as a BYOK provider inside Copilot for JetBrains (GitHub Changelog). Unsloth released Unsloth Desktop with a command literally named unsloth start claude, which points Claude Code and Codex...
msitarzewski/agency-agents added 446 stars today, packaging personas across "divisions" (frontend specialists, community experts, fact-checkers, reality checkers), each defined with a voice, a process, and concrete deliverables rather than a generic prompt template (GitHub). I...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.