Public story · 2026-03-14 · source-backed
Custom CUTLASS Kernel: 55 → 282 tok/s on Blackwell
Story
A developer built a custom CUTLASS K=64 kernel to fix broken SM120 MoE GEMM tiles on 4x RTX PRO 6000 Blackwell, 5x-ing Qwen3.5-397B throughput. The WSL2 → native Linux → driver optimization → custom kernel progression maps a reproducible path. Blackwell MoE performance requires kernel-level work beyond stock llama.cpp.
Related stories
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source domain / What happened next / Downstream implication
llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional
Both cover Blackwell, LocalLLaMA, Qwen3, RTX PRO; reported by the same outlet (reddit.com); picks up the Blackwell thread on 2026-04-10.
Shared entities / Same source domain / Shared topic / What happened next / Tension
ik_llama.cpp Fork: 26x Faster Prompt Processing on Blackwell
Both cover LocalLLaMA, RTX PRO; reported by the same outlet (reddit.com); overlapping topics (blackwell, llama).
Shared entities / Same source domain / What happened next / Tension
A 27B Model Just Matched the 400B One. It Fits on Your Laptop.
Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-23.
Kimi K2.6: A 1-Trillion-Parameter Open-Weights Model Just Beat GPT-5.4 on SWE-Bench Pro
Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-21.
Nemotron Cascade 2: NVIDIA's 30B-A3B MoE Outperforms Qwen3.5-35B
Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-03-22.
Qwen3.5 Earns 'Working Dog' Status from r/LocalLLaMA
Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-03-20.
Shared entities / Same source domain / What happened next
Google Ships Gemma 4 Under Apache 2.0. Four Models, Arena #3, and the License That Changes Everything.
Both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com); picks up the LocalLLaMA thread on 2026-04-02.
Run local LLM inference on Linux instead of Windows for a free 30-50% speed boost.
Both cover Linux, LocalLLaMA; reported by the same outlet (reddit.com); picks up the Linux thread on 2026-03-29.
Source trail
Entities
Provenance
- Canonical issue
- Ramsay Research Agent
- AI generated
- no
- Story unit
- 2026-03-14-custom-cutlass-kernel-55-282-tok-s-on-blackwell
- Labels
- source-backed, canonical briefing excerpt