Public story · 2026-03-14 · source-backed

Custom CUTLASS Kernel: 55 → 282 tok/s on Blackwell

Issue

2026-03-14

Confidence

source-backed

Sources

Redaction

passed

Story

A developer built a custom CUTLASS K=64 kernel to fix broken SM120 MoE GEMM tiles on 4x RTX PRO 6000 Blackwell, 5x-ing Qwen3.5-397B throughput. The WSL2 → native Linux → driver optimization → custom kernel progression maps a reproducible path. Blackwell MoE performance requires kernel-level work beyond stock llama.cpp.

NVIDIA released Blackwell / Shared entities / Same source domain / What happened next / Downstream implication
llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional
Linked by a graph relationship (NVIDIA released Blackwell); both cover Blackwell, LocalLLaMA, Qwen3, RTX PRO; reported by the same outlet (reddit.com).
Unsloth supports Blackwell / Shared entities / Same source domain / What happened next / Tension
A 27B Model Just Matched the 400B One. It Fits on Your Laptop.
Linked by a graph relationship (Unsloth supports Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).
NVIDIA released Blackwell / Shared entity: LocalLLaMA / What happened next
Local models became a first-class feature of hosted coding agents in a 48-hour window
Linked by a graph relationship (NVIDIA released Blackwell); both cover LocalLLaMA; picks up the LocalLLaMA thread on 2026-08-12.
NVIDIA released Blackwell / Shared entities / Same source domain / What happened next / Tension
Nemotron Cascade 2: NVIDIA's 30B-A3B MoE Outperforms Qwen3.5-35B
Linked by a graph relationship (NVIDIA released Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).
Vera Rubin benchmarked against Blackwell / Shared entity: Blackwell / What happened next / Tension
NVIDIA put Vera Rubin into full production: up to 10x lower inference token cost, 4x fewer GPUs to train MoE models versus Blackwell.
Linked by a graph relationship (Vera Rubin benchmarked against Blackwell); both cover Blackwell; picks up the Blackwell thread on 2026-06-02.
Unsloth supports Blackwell / Shared entities / Same source domain / What happened next
Qwen3.8-27B ran 80 unattended tool calls to scrape a university portal, then installed Whisper on its own.
Linked by a graph relationship (Unsloth supports Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).
NVIDIA released Blackwell / Shared entities / Same source domain / What happened next
Qwen3.8-2.4T-A95B: 2.4 trillion parameters, open weights, day-0 vLLM.
Linked by a graph relationship (NVIDIA released Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).
Meta ships Muse Glimmer, a 30B open agent model
Linked by a graph relationship (NVIDIA released Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).

Source trail

built a custom CUTLASS K=64 kernel

Entities

Blackwell Blackwell MoE Custom CUTLASS Kernel CUTLASS Linux LocalLLaMA Qwen3 RTX PRO SM120 MoE GEMM

Provenance

Canonical issue: Ramsay Research Agent
AI generated: no
Story unit: 2026-03-14-custom-cutlass-kernel-55-282-tok-s-on-blackwell
Labels: source-backed, canonical briefing excerpt

Fetching from the wire…

Custom CUTLASS Kernel: 55 → 282 tok/s on Blackwell

Story

Related stories

llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional

A 27B Model Just Matched the 400B One. It Fits on Your Laptop.

Local models became a first-class feature of hosted coding agents in a 48-hour window

Nemotron Cascade 2: NVIDIA's 30B-A3B MoE Outperforms Qwen3.5-35B

NVIDIA put Vera Rubin into full production: up to 10x lower inference token cost, 4x fewer GPUs to train MoE models versus Blackwell.

Qwen3.8-27B ran 80 unattended tool calls to scrape a university portal, then installed Whisper on its own.

Qwen3.8-2.4T-A95B: 2.4 trillion parameters, open weights, day-0 vLLM.

Meta ships Muse Glimmer, a 30B open agent model

Source trail

Entities

Provenance

Custom CUTLASS Kernel: 55 → 282 tok/s on Blackwell

Story

Related stories

llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional

A 27B Model Just Matched the 400B One. It Fits on Your Laptop.

Local models became a first-class feature of hosted coding agents in a 48-hour window

Nemotron Cascade 2: NVIDIA's 30B-A3B MoE Outperforms Qwen3.5-35B

NVIDIA put Vera Rubin into full production: up to 10x lower inference token cost, 4x fewer GPUs to train MoE models versus Blackwell.

Qwen3.8-27B ran 80 unattended tool calls to scrape a university portal, then installed Whisper on its own.

Qwen3.8-2.4T-A95B: 2.4 trillion parameters, open weights, day-0 vLLM.

Meta ships Muse Glimmer, a 30B open agent model

Source trail

Entities

Provenance