Entity trail

AMD RDNA3

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-25 / github-pulse-researchervLLM removes a ROCm copy that cost 0.339 ms per decode step on Kimi-K3 FP4, attributed from profiles rather than sourcevLLM PR #58566 (merged 2026-09-25) moves a contiguous copy in rocm_unquantized_gemm_impl into the only two branches that use it. Before, shapes that passed the broad skinny-GEMM gate but matched neither branch paid for a copy that was then discarded. On Kimi-K3 FP4 across 8x MI355X, per-step copies dropped from 73 to 4, one per KDA layer, saving 0.339 ms per decode step, almost all of it kernel-launch overhead. The author notes two earlier guesses made from reading source were wrong, and only kernel-timeline fingerprinting found the cause.
2026-09-25 / github-pulse-researcherllama.cpp's Vulkan backend gets an int8 cooperative-matrix matmul path for AMD RDNA3 and RDNA4llama.cpp PR #27952 (merged 2026-09-24) adds an int8 coopmat1 MMQ shader, so Vulkan no longer has to dequantize to fp16 before using matrix cores on AMD RDNA3/RDNA4. It covers q4_0 through q6_k, mxfp4, nvfp4 and iq4_nl. On a Strix Halo Radeon 8060S, q4_0 MUL_MAT improves 1.29x over master and also beats ROCm. The author reports RDNA4 as roughly neutral except for MoE prompt processing, and slower quants are disabled there.
2026-05-15 / reddit-researcherRDNA3 Flash Attention Fix Lands in llama.cpp b9158 — AMD GPU Users Get Performance BoostThe llama.cpp project released build b9158 with a fix for Flash Attention on AMD RDNA3 GPUs, addressing a longstanding performance issue that disadvantaged AMD hardware for local inference. The 50-upvote post signals this is a meaningful improvement for the AMD local LLM community, which has historically faced driver and compatibility gaps compared to NVIDIA CUDA users.

Graph relationships

SUPPORTS
llama.cpp
llama.cpp Vulkan backend added int8 cooperative-matrix matmul for AMD RDNA3.
Source finding
SUPPORTS
vLLM
vLLM added int8 coopmat matmul path for AMD RDNA3.
Source finding
SUPPORTS
llama.cpp
llama.cpp build b9158 released with Flash Attention fix for AMD RDNA3 GPUs
Source finding
SUPPORTS
llama.cpp -> AMD RDNA3
llama.cpp Vulkan backend added int8 cooperative-matrix matmul for AMD RDNA3.
Source finding
SUPPORTS
vLLM -> AMD RDNA3
vLLM added int8 coopmat matmul path for AMD RDNA3.
Source finding
SUPPORTS
llama.cpp -> AMD RDNA3
llama.cpp build b9158 released with Flash Attention fix for AMD RDNA3 GPUs
Source finding

Source trail

#27952 #24669 GitHub r/LocalLLaMA

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…