Fetching from the wire…
Vibe Coding2026-08-30 · source-backed
Unsloth's UD-Q2_K_XL (78.9 GB) plus a 358,400-token slot via YaRN from the native 262,144 with fp16 KV fits under the default 96GB Metal wired limit, no sysctl hack. Cold prefill runs 1,561 t/s at 5.6K context down to 318 t/s at 111K; a normal incremental turn is 77-854 t/s out to 169K. (r/LocalLLaMA) The expensive detail is idle behavior: after about 20 minutes of pause the slot retained only its 5.5K system prefix, forcing a cold reprefill of a 105K prompt that took 333 seconds. If you walk away from a long local session, you pay for it on return.
Each link below shares sources, entities, or timing with this story.
Unsloth supports DeepSeek / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Unsloth supports DeepSeek); both cover Flash, LocalLLaMA, M5 Max, Qwen3; reported by the same outlet (reddit.com).
Linked by a graph relationship (Unsloth supports DeepSeek); both cover Flash, LocalLLaMA, Metal; reported by the same outlet (reddit.com).
Unsloth supports Blackwell / Shared entities / Same source domain / Earlier coverage / Downstream implication
Linked by a graph relationship (Unsloth supports Blackwell); both cover LocalLLaMA, Qwen3; reported by the same outlet (reddit.com).
QLoRA uses Unsloth / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (QLoRA uses Unsloth); both cover Qwen3, Unsloth; earlier Qwen3 coverage from 2026-06-20.
Unsloth supports Qwen / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Unsloth supports Qwen); both cover LocalLLaMA, M5 Max, Qwen3, Unsloth; reported by the same outlet (reddit.com).
Unsloth supports Qwen / Shared entities / Earlier coverage
Linked by a graph relationship (Unsloth supports Qwen); both cover Flash, LocalLLaMA, Next, Qwen3; earlier Flash coverage from 2026-08-26.
Unsloth supports Qwen / Shared entities / Same source domain / Earlier coverage
Linked by a graph relationship (Unsloth supports Qwen); both cover LocalLLaMA, Someone, Unsloth; reported by the same outlet (reddit.com).
Linked by a graph relationship (Unsloth supports Qwen); both cover Flash, LocalLLaMA, Next, Qwen3; reported by the same outlet (reddit.com).