Fetching from the wire…
Models2026-08-29 · source-backed
Two methods: GSQ (Gumbel-Softmax Quantization), post-training scalar quantization that jointly learns grid assignments and scales at 2-3 bits, and RCO (Riemannian Constrained Optimization), assigning a quant type per tensor under a strict size budget by gradient descent on the task loss. The 3.00 bpw build (10.1 GB) matches the BF16 base on AIME25 at 100.00, comes within about a point on GPQA-Diamond (88.89 against 89.90) and LiveCodeBench v6 (84.57 against 85.71). The 2.75 bpw build (9.3 GB) still reaches AIME25 100.00 with a zero-shot average exceeding BF16. All three files run unmodified in llama.cpp, Ollama and LM Studio. Given today's GGUF filename audit, verify the bpw yourself before quoting these. (r/LocalLLaMA)
Each link below shares sources, entities, or timing with this story.
Ollama uses MLX / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Ollama uses MLX); both cover GGUF, LM Studio, LocalLLaMA, Ollama; reported by the same outlet (reddit.com).
Kimi K3 benchmarked against LiveCodeBench / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Kimi K3 benchmarked against LiveCodeBench); both cover Diamond, GGUF, GPQA, LocalLLaMA; reported by the same outlet (reddit.com).
LLM supports LM Studio / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (LLM supports LM Studio); both cover LocalLLaMA, Ollama; reported by the same outlet (reddit.com).
Ollama supports Qwen / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Ollama supports Qwen); both cover GGUF, LocalLLaMA, Ollama; reported by the same outlet (reddit.com).
Ollama uses MLX / Shared entity: LocalLLaMA / Same source domain / Earlier coverage
Linked by a graph relationship (Ollama uses MLX); both cover LocalLLaMA; reported by the same outlet (reddit.com).
Ollama supports Qwen / Shared entity: GGUF / Shared topic / Earlier coverage
Linked by a graph relationship (Ollama supports Qwen); both cover GGUF; overlapping topics (against, base).
Ollama supports Qwen / Shared entity: LocalLLaMA / Same source domain / Earlier coverage
Linked by a graph relationship (Ollama supports Qwen); both cover LocalLLaMA; reported by the same outlet (reddit.com).
Ollama supports Qwen / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Ollama supports Qwen); both cover LiveCodeBench, LocalLLaMA; reported by the same outlet (reddit.com).