Reddit
Llama.cpp Benchmark Shootout: RTX 5090 vs DGX Spark vs AMD AI395 — First Comprehensive Local Inference Comparison
A detailed llama-bench (build 8463) comparison across RTX 5090, NVIDIA DGX Spark, and AMD AI395/R9700 (ROCm and Vulkan) posted to r/LocalLLaMA with 56 upvotes and 69 comments (1.23 ratio, indicating high technical engagement). Separately, a Qwen3.5-397B-A17B benchmark showed 20 tok/s TG and 700 tok/s PP on a single 5090 with 256GB DDR4 RAM (56 upvotes, 46 comments). Together these provide the first real-world inference performance data for the latest consumer and enterprise hardware.
Source
↳ Follow the thread