Top 5 · 2026-04-08 · source-backed
GLM-5.1: Open-Weight 754B Model Takes #1 on SWE-Bench Pro, Runs 8 Hours Unsupervised. MIT Licensed.
Story
An open-weight model just beat every closed frontier model on the benchmark builders actually care about.
Z.AI (formerly Zhipu AI) dropped GLM-5.1, a 754-billion parameter mixture-of-experts model with 40 billion active parameters. The SWE-Bench Pro score: 58.4%. That's above GPT-5.4, above Claude Opus 4.6, above Gemini 3.1 Pro. An MIT-licensed model you can download and run just took the top spot.
But the benchmark number isn't the headline. Simon Willison tested it and the result was something I haven't seen from any model. He gave it a single prompt: build a Linux-style desktop environment as a web application. No starter code, no mockups. The model ran for eight hours autonomously. Eight hours of planning, experimenting, reading results, hitting blockers, and pushing through them. Over 600 iterations and thousands of tool calls with maintained goal alignment throughout.
That's not code generation. That's a sustained engineering session.
The practical specs: 95.3 on AIME 2026, 86.2 on GPQA-Diamond, 200K context window, 131K max output tokens. At 40B active parameters, it's tractable on high-end consumer hardware. Think 2-3x 4090s. vLLM had a tagged image within 20 minutes of release. The model is 1.51TB on HuggingFace and available right now.
Reddit's r/LocalLLaMA lit up with 604 upvotes and people immediately pairing it with Nous Research's Hermes Agent framework. The open-source agent stack now has a model that can hold context and execute tasks over hours, not minutes.
My take: the 8-hour autonomous execution is the bigger deal than the benchmark score. SWE-Bench measures one-shot problem solving. Real engineering requires sustained attention, course correction, and the willingness to back up and try a different approach. GLM-5.1 does that. If you're running local models for agent workloads, this should be your first evaluation target.
Related stories
Each link below shares sources, entities, or timing with this story.
Shared entities / Shared topic / What happened next
GLM-5.1 Becomes the First Open Model to Crack Code Arena's Top 3. It Costs a Third of What Opus Does.
Both cover Bench, Bench Pro, Gemini, GLM; overlapping topics (agent, benchmark, code, glm-5, model); picks up the Bench thread on 2026-04-11.
Shared entities / Shared topic / What happened next / Tension
Kimi K2.6 Beats GPT-5.4 on SWE-Bench Pro. It's Open-Weight. It Costs 88% Less.
Both cover Bench Pro, Claude Opus, GLM, GPT; overlapping topics (agent, benchmark, glm-5, model, open-weight); picks up the Bench Pro thread on 2026-05-05.
Shared entities / Shared topic / What happened next
Cognition built a coding benchmark that real maintainers grade, and the best model scores 13.4%
Both cover Bench, Bench Pro, Claude Opus, Diamond; overlapping topics (agent, benchmark, code, swe-bench); picks up the Bench thread on 2026-06-09.
Shared entities / Shared topic / What happened next / Tension
Kimi K2.6: A 1-Trillion-Parameter Open-Weights Model Just Beat GPT-5.4 on SWE-Bench Pro
Both cover Bench, Bench Pro, Claude Opus, GPT; overlapping topics (agent, benchmark, model, swe-bench); picks up the Bench thread on 2026-04-21.
An Open-Source Model Just Beat GPT-5.4 and Opus 4.6 on the Hardest Coding Benchmark
Both cover Claude Opus, GLM, GPT, SWE; overlapping topics (active, benchmark, glm-5, model, open-weight); picks up the Claude Opus thread on 2026-04-20.
Shared entities / Same source domain / Shared topic / What happened next
DeepSeek V4 Preview Drops: 1.6T Parameters, 1M Context, Apache 2.0, and a 35x Price Gap That Should Make Every Builder Rethink Their Inference Budget
Both cover Bench, GPT, LocalLLaMA, Simon Willison; reported by the same outlet (huggingface.co, simonwillison.net); overlapping topics (benchmark, context, parameter).
Shared entities / Shared topic / What happened next
An Open-Weight Model Just Beat Opus 4.6 and GPT-5.4 on the Hardest Coding Benchmark. MIT Licensed.
Both cover Bench Pro, GLM, GPT, MIT Licensed; overlapping topics (agent, benchmark, engineering, glm-5, model); picks up the Bench Pro thread on 2026-04-09.
Shared entities / Same source domain / Shared topic / What happened next / Tension
A 27B Model Just Matched the 400B One. It Fits on Your Laptop.
Both cover Claude Opus, LocalLLaMA, Simon Willison, SWE; reported by the same outlet (huggingface.co, simonwillison.net); overlapping topics (code, model, swe-bench).
Source trail
Entities
Provenance
- Canonical issue
- Ramsay Research Agent — April 8, 2026
- AI generated
- no
- Story unit
- 2026-04-08-glm-5-1-open-weight-754b-model-takes-1-on-swe-bench-pro-runs-8-hours-unsupervised-mit-licensed
- Labels
- source-backed, canonical briefing excerpt