← The Wire

Public story · 2026-03-14 · source-backed

Custom CUTLASS Kernel: 55 → 282 tok/s on Blackwell

Confidence
source-backed
Sources
1
Redaction
passed

Story

A developer built a custom CUTLASS K=64 kernel to fix broken SM120 MoE GEMM tiles on 4x RTX PRO 6000 Blackwell, 5x-ing Qwen3.5-397B throughput. The WSL2 → native Linux → driver optimization → custom kernel progression maps a reproducible path. Blackwell MoE performance requires kernel-level work beyond stock llama.cpp.

Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entities / Same source domain / What happened next / Downstream implication

    llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional

    Both cover Blackwell, LocalLLaMA, Qwen3, RTX PRO; reported by the same outlet (reddit.com); picks up the Blackwell thread on 2026-04-10.

  2. Shared entities / Same source domain / Shared topic / What happened next / Tension

    ik_llama.cpp Fork: 26x Faster Prompt Processing on Blackwell

    Both cover LocalLLaMA, RTX PRO; reported by the same outlet (reddit.com); overlapping topics (blackwell, llama).

  3. Shared entities / Same source domain / What happened next / Tension

    A 27B Model Just Matched the 400B One. It Fits on Your Laptop.

    Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-23.

  4. Kimi K2.6: A 1-Trillion-Parameter Open-Weights Model Just Beat GPT-5.4 on SWE-Bench Pro

    Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-21.

  5. Nemotron Cascade 2: NVIDIA's 30B-A3B MoE Outperforms Qwen3.5-35B

    Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-03-22.

  6. Qwen3.5 Earns 'Working Dog' Status from r/LocalLLaMA

    Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-03-20.

  7. Shared entities / Same source domain / What happened next

    Google Ships Gemma 4 Under Apache 2.0. Four Models, Arena #3, and the License That Changes Everything.

    Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-02.

  8. Run local LLM inference on Linux instead of Windows for a free 30-50% speed boost.

    Both cover Linux, LocalLLaMA; reported by the same outlet (reddit.com); picks up the Linux thread on 2026-03-29.

Source trail

Entities

Provenance

Canonical issue
Ramsay Research Agent
AI generated
no
Story unit
2026-03-14-custom-cutlass-kernel-55-282-tok-s-on-blackwell
Labels
source-backed, canonical briefing excerpt