Fetching from the wire…
Infra2026-09-19 · source-backed
PR #28389 fixes argsort_f32_i32_cuda_cub() passing the same buffer as d_keys_in and d_keys_out, violating CUB's non-overlap contract. CUB's double-buffer ping-pong overwrote its own input mid-pass and emitted float bit patterns as row IDs, producing out-of-bounds get_rows reads and sticky Xid 31 faults. It only fired above ncols > 1024 with real logit distributions, reproduced on Qwen3.8-27B DFlash speculative decoding with a 248,320-column vocabulary crashing within 1 to 3 tokens. llama.cpp The fix allocates a distinct output buffer at six call sites for about 64MB more transient memory per sort.
Each link below shares sources, entities, or timing with this story.
Intel's release on September 16 covers Kokoro-82M, Qwen3-VL-4B with EAGLE-3 speculative decoding, Qwen3-ASR, Muse Glimmer 30B, Hy-MT2-1.8B and Granite 4.0 H Micro, with Gemma-3n on CPU and FLUX.2-Klein 4B plus Kokoro-82M on NPUs. Early-release CPU/GPU enablement adds Qwen-Imag...
Moonshot AI dropped Kimi K2.6 today and the numbers are hard to ignore. One trillion parameters total, 32 billion active per token across 384 experts, 256K context window, and native multimodal input. It scores 58.6 on SWE-Bench Pro versus GPT-5.4's 57.7 and Claude Opus 4.6's...
A Hugging Face post dated September 10 documents 96+ hours across 1,000+ quantization configurations on Qwen 3.5 0.8B and 4B, producing per-tensor layout maps replacing the generic GGUF heuristics. Findings: token embeddings are 8-16x more sensitive to degradation than other w...
The abliteration tool gained 215 stars to reach 30,103, but the stronger signal is downstream: the HF trending endpoint returns DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU and Momoking/Qwen3-VL-32B-Heretic-MiniMax-H3-NVFP4, both naming the too...
The models are good. The license is the real story. Google released Gemma 4 on April 2 with four variants: E2B, E4B, 26B MoE, and 31B Dense. All built on the Gemini 3 architecture. The 31B Dense variant claimed #3 on Arena AI's text leaderboard, beating models 20x its size. Th...
PR #19378 landed in llama.cpp this week, and I think most people are underselling what it means. Backend-agnostic tensor parallelism via --split-mode tensor makes multi-GPU inference work across AMD, Intel, and Apple Silicon. Not just CUDA. Everything. For context: llama.cpp h...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.