← The Wire

Public story · 2026-03-21 · source-backed

Qwen3.5-9B Hits 93.8% on HomeSec-Bench — 4.1 Points Behind GPT-5.4

Confidence
source-backed
Sources
1
Redaction
passed

Story

SharpAI's HomeSec-Bench shows Qwen3.5-9B running locally on MacBook M5 Pro at 25 tokens/second using only 13.8GB unified memory achieves 93.8%, outperforming GPT-5.4-nano (92.7%) and nearly matching GPT-5.4-mini (95.8%). The larger Qwen3.5-35B-MoE delivers faster first-token response (435ms) than all tested OpenAI cloud models. Local models matching cloud on specialized tasks is now repeatable, not anecdotal.

Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entities / Shared topic / What happened next / Tension

    Kimi K2.6: A 1-Trillion-Parameter Open-Weights Model Just Beat GPT-5.4 on SWE-Bench Pro

    Both cover Bench, GPT, MoE, Qwen3; overlapping topics (gpt-5, model); picks up the Bench thread on 2026-04-21.

  2. GPT-5.5 Is Here. It's Fast, It's Expensive, and It Changes How You Prompt.

    Both cover Bench, GPT, OpenAI; overlapping topics (gpt-5, matching, model); picks up the Bench thread on 2026-04-25.

  3. An Open-Source Model Just Beat GPT-5.4 and Opus 4.6 on the Hardest Coding Benchmark

    Both cover GPT, MoE, OpenAI; overlapping topics (gpt-5, model); picks up the GPT thread on 2026-04-20.

  4. Shared entities / Shared topic / What happened next

    GLM-5.2 is the hedge, and the benchmarks say it's a real one

    Both cover Bench, GPT, MoE; overlapping topics (behind, gpt-5, model); picks up the Bench thread on 2026-06-21.

  5. Shared entities / What happened next

    Meta Killed Llama's Open-Source Promise. No Migration Path.

    Both cover GPT, Local, MoE, OpenAI; picks up the GPT thread on 2026-05-02.

  6. DeepSeek V4 Preview Drops: 1.6T Parameters, 1M Context, Apache 2.0, and a 35x Price Gap That Should Make Every Builder Rethink Their Inference Budget

    Both cover Bench, GPT, MoE, OpenAI; picks up the Bench thread on 2026-04-24.

  7. Shared entities / Shared topic / What happened next

    OpenAI published the GPT-5.6 Preview System Card with the eval data.

    Both cover Bench, GPT, OpenAI; overlapping topics (behind, gpt-5); picks up the Bench thread on 2026-06-29.

  8. OpenAI shipped GPT-5.6 'Sol' and then handed the keys to Washington

    Both cover Bench, GPT, OpenAI; overlapping topics (gpt-5, model); picks up the Bench thread on 2026-06-26.

Source trail

Entities

Provenance

AI generated
no
Story unit
2026-03-21-qwen3-5-9b-hits-93-8-on-homesec-bench-4-1-points-behind-gpt-5-4
Labels
source-backed, canonical briefing excerpt
Qwen3.5-9B Hits 93.8% on HomeSec-Bench — 4.1 Points Behind GPT-5.4 | MindPattern