Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-09-06 · high
The same September 5 build fixes structured output on Apple Silicon and adds OpenAI-compatible tool search.
Why now: Ollama posted the rc1 notes on September 5, the same day r/LocalLLaMA's top thread argued whether open models have already closed the gap.
Ollama released v0.34.0-rc1 on September 5 at 23:49 UTC. The build lets ChatGPT Desktop select Ollama-hosted open models directly, with setup handled through the Ollama macOS app.
Running local models has meant giving up a polished client for a terminal or self-hosted UI that's maybe 80% as good. This removes that trade for the kinds of work where a local model is already good enough.
The same release improves structured-output performance on Apple Silicon and adds OpenAI-compatible tool search plus response compaction. Local models usually reason fine and fail at emitting valid JSON on the first try. That failure has kept local tool calling from working reliably.
The release sits next to r/LocalLLaMA's top thread of the day. Someone there, running a cybersecurity network, says they can't tell frontier output from the best open weights, naming DeepSeek V4 Flash as neck-and-neck. The top reply, at 226 upvotes, disagrees. It argues the gap hasn't closed while Astra and Fable 5.1 exist, but 99% of people already have what they need in open models.
NVIDIA also released PAIR, an Apache-2.0 router that pools every GPU on a LAN, including Apple M4+ Macs behind Ollama and LM Studio. Its demo cut a five-subagent Qwen 3.6 35B A3B run from 18 minutes on one laptop to 8 minutes 48 seconds across three devices. NVIDIA calls the result configuration-specific and says it isn't a benchmark.
Each link below shares sources, entities, or timing with this story.
PR #19378 landed in llama.cpp this week, and I think most people are underselling what it means. Backend-agnostic tensor parallelism via --split-mode tensor makes multi-GPU inference work across AMD, Intel, and Apple Silicon. Not just CUDA. Everything. For context: llama.cpp h...
For about a year, "run your agent locally" meant accepting a model that couldn't reliably call a tool twice in a row. That excuse is gone. Meta Superintelligence Labs published Muse Glimmer today: a 29.6B dense causal transformer, 52 layers, 6,656 hidden dim, with a ~1.8B ViT-...
OpenClaw tagged v2026.8.1 at 03:30 UTC this morning. The release post counts 933 contributors, 569 of them first-time, and more than 16,000 pull requests, roughly half of every PR ever merged into the project, after a seven-week gap against a prior cadence of 106 releases in 2...
Alibaba released Qwen3.6-27B on April 22. Dense architecture. Open weights. 77.2% on SWE-bench Verified, within 3.7 points of Claude Opus 4.6. On SkillsBench, it scores 48.2% versus its own 397B MoE predecessor's 30.0%. That's a 77% improvement with 14.8x fewer parameters. Let...
Three moves, two days, no coordination between them. August 10–11: GitHub shipped Ollama as a BYOK provider inside Copilot for JetBrains (GitHub Changelog). Unsloth released Unsloth Desktop with a command literally named unsloth start claude, which points Claude Code and Codex...
Lily is Apache 2.0 inside pplx-garden, a small Metal inference server built for Qwen3.6-35B-A3B converted to MLX affine 4-bit, exposing a minimal OpenAI-compatible chat API with greedy decoding. The README explicitly rules out dense and smaller Qwen checkpoints, BF16, GGUF, AW...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.