Fetching from the wire…
Models2026-09-13 · source-backed
A Hugging Face post dated September 10 documents 96+ hours across 1,000+ quantization configurations on Qwen 3.5 0.8B and 4B, producing per-tensor layout maps replacing the generic GGUF heuristics. Findings: token embeddings are 8-16x more sensitive to degradation than other weights, sensitivity follows a U-shape by model depth, attention projections matter, gate tensors mostly don't. Q3_K_M on Qwen3.5-4B comes out 15% smaller with quality called marginally better across the board, validated against Gemma, Granite and DeepSeek with a canary test for generalization. r/LocalLLaMA picked it up at 213 upvotes when bartowski re-uploaded the Qwen3.8-27B GGUFs under the new layout. Measure-then-quantize beating a heuristic is unsurprising; the size win at equal quality is what makes it worth re-downloading.
Each link below shares sources, entities, or timing with this story.
Hugging Face published its Summer 2026 State of Open Models report on August 14, and one statistic in it went almost entirely unremarked in the coverage. By July 2026, agents rather than humans became the Hub's primary users. Claude Code alone accounted for 44.4% of all agent...
For about a year, "run your agent locally" meant accepting a model that couldn't reliably call a tool twice in a row. That excuse is gone. Meta Superintelligence Labs published Muse Glimmer today: a 29.6B dense causal transformer, 52 layers, 6,656 hidden dim, with a ~1.8B ViT-...
Alibaba released Qwen3.6-27B on April 22. Dense architecture. Open weights. 77.2% on SWE-bench Verified, within 3.7 points of Claude Opus 4.6. On SkillsBench, it scores 48.2% versus its own 397B MoE predecessor's 30.0%. That's a 77% improvement with 14.8x fewer parameters. Let...
The models are good. The license is the real story. Google released Gemma 4 on April 2 with four variants: E2B, E4B, 26B MoE, and 31B Dense. All built on the Gemini 3 architecture. The 31B Dense variant claimed #3 on Arena AI's text leaderboard, beating models 20x its size. Th...
Staged on ModelScope for 23:00 Beijing time August 26, it's roughly 125B parameters plus a separate N-gram embedding table of about 51B, activating 6B per token, with GDN gated-delta hybrid layers and Qwen Sparse Attention. Alibaba frames it as a technology preview of the Qwen...
Alibaba published a fine-grained MoE with 2.4T total / 95B active, 512 experts, and a 92-layer hybrid full/linear attention backbone. vLLM shipped day-0 support verified on NVIDIA and AMD with ready 4-bit checkpoints (NVFP4 at 1.32 TiB for an 8xB300 node, MXFP4 at 1.45 TiB for...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.