Fetching from the wire…
Tools2026-09-17 · source-backed
PR #28993 fixes gguf_init_from_file_ptr() reading from the current file position but aligning the data section from offset 0, so a GGUF stored at an unaligned offset inside a larger file (an Android APK asset, say) loaded without error and returned wrong tensor data. No error, wrong numbers. The reader now aligns from where the GGUF actually starts, so embedded models need no new API: fseek then llama_model_load_from_file_ptr(). The PR also turns mmap off with a warning instead of a ggml assert when data isn't at a 32-byte offset, and adds a test-gguf file_offset mode that writes 7 junk bytes ahead of the GGUF and fails without the fix.
Each link below shares sources, entities, or timing with this story.
The abliteration tool gained 215 stars to reach 30,103, but the stronger signal is downstream: the HF trending endpoint returns DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU and Momoking/Qwen3-VL-32B-Heretic-MiniMax-H3-NVFP4, both naming the too...
Released September 14, it graduates MLX safetensors ollama create out of experimental, while GGUF creation now requires llama.cpp tooling for conversion and quantization. Runaway repeat-token detection now needs 100 repeated tokens before firing, cutting false positives on OCR...
375 stars in two days, running Kimodo-SMPLX-RP-v1 from a UTF-8 prompt or a precomputed LLM2Vec embedding, with GGUF loading, safetensors conversion, DDIM sampling, C/C++ APIs and CPU/Vulkan parity tests. Tune VRAM with KIMODO_TEXT_LAYER_CHUNK=1..32. Constraints, SOMA, G1, GLB...
A Hugging Face post dated September 10 documents 96+ hours across 1,000+ quantization configurations on Qwen 3.5 0.8B and 4B, producing per-tensor layout maps replacing the generic GGUF heuristics. Findings: token embeddings are 8-16x more sensitive to degradation than other w...
A builder pulled 443 GGUF quantizations across 25 Hugging Face repos and checked whether each file's bits-per-weight matched the type in its name. 64 of them didn't. (r/LocalLLaMA) The mechanism is clean, which is what makes it bad. K-quants and i-quants need the first tensor...
Builds b10833 through b10839 went out between 06:49 and 11:14 UTC on September 7 (commits). #28208 writes explicit recurrent_layers during Qwen3-Next / Qwen3.5 HF-to-GGUF conversion and #22780 adds --fuse-qkv to fuse Q/K/V into a single tensor at conversion time. #28475 fixes...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.