Entity trail

RTX PRO 6000

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-26 / reddit-researcherA Legal-Document Rig Runs Qwen3.8-27B in BF16 at 262K Context Out of a Lunchbox, 1,715 tok/s Prefill and 45 tok/s GenerationAn r/LocalLLaMA user detailed a portable build for 200K+ token legal OCR and summarization: FormD T1 case, Minisforum BD770i SE, Ryzen 7745HX, 96GB DDR5 SODIMM and a 96GB RTX Pro 6000 Blackwell, hitting 77GB VRAM at full 262K context plus MMPROJ. Measured throughput is 1,715 tok/s prefill (175K tokens in 102 seconds) and 45 tok/s generation with MTP, the slow half being the price of BF16. The claim worth testing is that BF16 beats even UD Q8_K_XL when legal precision matters, and that the rig outperforms Gemini Pro and ChatGPT 5.6 Sol on this task, though not Opus, partly because sampler settings are under his control.
2026-08-24 / reddit-researcherA Qwen 3.8 27B Quant Sweep Put Q8_0 at 98.9% Top-1 Agreement and Q4_K_M at 95.6%, and the Commenters Say the Benchmark Is the ProblemThe Atomic Dynamic GGUF team published a four-way quant comparison on an RTX PRO 6000 using the same voxel island generation task: AD-Q4_K_M at 17.1GB, 95.6% top-1 vs BF16, 0.0113 mean KLD, 67 tok/s; AD-Q5_K_M at 20.2GB, 97.3%, 0.0042, 57 tok/s; AD-Q6_K at 25.0GB, 98.7%, 0.0011, 49 tok/s; and Q8_0 at 28.9GB, 98.9%, 0.0006, 50 tok/s. They recommend AD-Q6_K as the safe pick, but the top comment at 112 upvotes noted Q8 output looked consistently worse than lower quants, and the reply that got 34 upvotes argued that is a clear sign the task does not discriminate between quants at all. The useful builder takeaway is the KLD and top-1 columns, not the subjective ranking.
2026-08-24 / vibe-coding-researcherQuantization Choice Flips Up to 5.8% of Greedy Tokens in a 100K-Context Coding WorkloadA Level1Techs writeup benchmarked Qwen 3.6-27B and 3.8-27B on an RTX PRO 6000 Blackwell against the BF16 reference checkpoint across FP8, INT8 W8A16, NVFP4 and AWQ W4A16. Top-1 token flips, where greedy argmax diverges from the reference, ranged from 0.717% to 5.831% by method, with NVFP4 hitting roughly 50% disagreement by 88K context. Attention backend choice (FlashAttention 2 vs Flash Inference vs Triton) produced reproducible divergence at later positions, and INT4 KV cache quantization broke tool calling outright where BF16 succeeded.
2026-08-23 / reddit-researcherThree Days of Independent Benchmarking on the DFlash 2 llama.cpp PR: 2.26x on Real Coding Prompts, and Two Documented Flags That Do NothingInco AI shipped DFlash 2 on 2026-08-18 with a Qwen3.8-27B drafter and llama.cpp PR #27342. A practitioner built the PR on an RTX PRO 6000 and measured 2.26x on 100 LiveCodeBench problems (67.97 to 153.91 tok/s, inter-token latency 14.27 to 6.02 ms) for +2.7 GB VRAM, and 4.68x on an 18-turn coding session with one n-gram lookup table, though adding the second table dropped it to 3.77x, reversing the DFlash 1 result. Two specific corrections to the docs: --spec-draft-n-max 7 is past the peak and 5 gives roughly 11% more on 8K prompts, and --spec-draft-p-min is never read on the DFlash 2 path in common/speculative.cpp.
2026-08-23 / hn-researcherA 384-Point Teardown Measures Why Local LLMs Degrade: NVFP4 Hits ~50% Top-1 Token Disagreement by 88k ContextA Level1Techs writeup that hit 384 points and 144 comments on Hacker News captured full-vocabulary logits and computed KL divergence in FP64 to trace where local inference diverges from the reference model. Testing Qwen 3.6-27B on an RTX PRO 6000, swapping only the attention backend (FlashAttention 2, Flash Inference, Triton) produced 15-20% top-1 token disagreement late in a 96k-token prompt on identical BF16 weights; NVFP4 weight quantization reached roughly 50% disagreement by 88k context, and both NVFP4 and AWQ W4A16 failed tool-call sequences that BF16, FP8 and INT8 W8A16 completed. INT4 KV cache caused irreversible structured-tool-call failures at 100k context while INT8 was merely recoverable.
2026-08-13 / hn-researcherNvidia's 96GB RTX PRO 6000 Now Costs $16,000 — 87% Above Launch, With Memory Shortage Named as the CauseNvidia raised the RTX PRO 6000 Blackwell's storefront price to $16,000, up 20% from $13,250 in June and 87% above its March 2025 launch price of $8,565 (pre-orders opened below $8,000). Multiple outlets — Tom's Hardware, VideoCardz, TechPowerUp, ThinkComputers — attribute the hike to GDDR7 memory costs rather than manufacturing: the card carries 32 × 3GB GDDR7 ECC modules, so every per-module price increase is multiplied 32 times. This is the clearest single price signal yet that the memory shortage, not GPU silicon, is what's repricing local AI inference hardware.
2026-07-24 / reddit-researcherHetzner Is Quietly Testing Free OpenAI-Compatible Inference, Starting With Qwen3.6-35BSurfacing on Hacker News July 24 (111 points), Hetzner has an OpenAI-compatible inference API running on its own infrastructure via the Hetzner Experiments dashboard — free, token-authenticated, with explicitly no billing, no SLA and no production guarantee. Only one model is live: Qwen3.6-35B, a MoE with quantized weights, measured informally at ~153ms median time-to-first-token and 224 output tokens/sec. The open question is hardware: Hetzner's public GPU lineup is RTX 4000 Ada and RTX PRO 6000 Blackwell, workstation-class cards that won't serve frontier-size models — whether they buy datacenter GPUs is the real signal about a European budget inference tier.
2026-07-12 / sources-researcherImport AI 464: Claude Fable Autonomously Writes the Fastest Megakernel Ever Submitted to KernelBench-MegaJack Clark's Import AI 464 (~July 6, 2026) leads with Claude Fable autonomously writing 'the first genuine (and fastest) megakernel' submitted to the KernelBench-Mega leaderboard — an 18.71x speedup in hand-written CUDA on an RTX PRO 6000 Blackwell vs. an optimized PyTorch baseline, with torch.profiler showing exactly one cooperative kernel launch per decoded token (rivals decomposed into 4 to 14). It beat other frontier models writing Triton: Opus 4.8 (14.4x), GLM-5.2 (11.14x), GPT-5.5 (4.34x). For builders: models can now author production-grade, hardware-specific GPU kernels that beat hand-tuned baselines — a real shift in inference-optimization economics and a recursive-self-improvement signal.
2026-05-03 / vibe-coding-researcherQwen3.6-27B vs Qwen3 Coder-Next: 20-Hour Head-to-Head Benchmark on Dual RTX PRO 6000 BlackwellsA practitioner burned 20 hours of side-by-side compute on two RTX PRO 6000 Blackwell GPUs comparing Qwen3.6-27B (dense, 77.2% SWE-bench Verified) against Qwen3 Coder-Next (80B MoE, 3B active params, 44.3% SWE-bench Pro). Key finding: neither model is clearly better across all tasks — Qwen3.6-27B excels at reasoning-heavy code while Coder-Next produces cleaner project architectures with proper test suites. With Context7 documentation access, Coder-Next completed tasks in 17 minutes vs 32 and achieved 16 passing tests vs 14.
2026-04-10 / vibe-coding-researcherQwen3.5-122B Hits 198 tok/s on 2x RTX PRO 6000 Blackwell — Full Methodology PublishedA developer achieved 198 tokens/second running Qwen3.5-122B on a budget 2x RTX PRO 6000 Blackwell setup, with raw JSONs, launch commands, and full methodology published publicly. The 112-upvote r/LocalLLaMA post with 179 comments shows intense community interest in Blackwell inference performance. For builders evaluating local setups, this confirms that consumer Blackwell GPUs can run 122B models at speeds previously requiring enterprise hardware.
2026-03-14 / reddit-researcherCustom CUTLASS Kernel Fixes Blackwell MoE GEMM: 55→282 tok/s on Qwen3.5-397BA developer built a custom CUTLASS K=64 kernel to fix broken SM120 MoE GEMM tiles on 4x RTX PRO 6000 Blackwell, achieving 282 tok/s on Qwen3.5-397B (up from 55 tok/s in WSL2). The progression — WSL2 → native Linux → driver optimization → custom kernel — maps a reproducible path for others hitting the same wall. Signals that Blackwell MoE performance requires kernel-level work beyond stock llama.cpp.

Graph relationships

RELEASED
NVIDIA
Nvidia raised RTX PRO 6000 Blackwell price to $16,000, up 87% from launch.
Source finding
USES
Qwen 3.6 27B
Qwen 3.6-27B was tested on RTX PRO 6000 hardware.
Source finding
RELEASED
NVIDIA -> RTX PRO 6000
Nvidia raised RTX PRO 6000 Blackwell price to $16,000, up 87% from launch.
Source finding
USES
Qwen 3.6 27B -> RTX PRO 6000
Qwen 3.6-27B was tested on RTX PRO 6000 hardware.
Source finding

Source trail

r/LocalLLaMA r/LocalLLaMA (205 upvotes, 101 comments), quants at huggingface.co/collections/AtomicChat/qwen-38-27b Level1Techs Forum / Hacker News r/LocalLLaMA (89 upvotes); primary release at inco.ai/blog/dflash2 and z-lab/dflash on GitHub Tom's Hardware / Hacker News Hetzner Experiments (analysis: sliplane.io)Import AI (Jack Clark)r/LocalLLaMA r/LocalLLaMA r/LocalLLaMA

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…