Entity trail

Tri Dao

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-07-26 / arxiv-researcherSonicSampler Unifies LLM Sampling and Speculative Verification Into One Triton Kernel, Up to 16× Faster on Heterogeneous BatchesPragaash Ponnusamy, Shivam Sahni, Jue Wang, and Tri Dao attack a real serving problem: existing sampling implementations accelerate only parts of the logit-processing/token-selection/verification pipeline, need multiple kernel launches, or assume every request in a batch samples the same way — which breaks CUDA Graph execution for dynamic workloads. Their Triton kernel suite handles grammar-constrained decoding, penalties, filtering, and speculative verification inside a single batched kernel while staying CUDA Graph compatible, with a hierarchical two-stage top-k giving up to 10× speedup and up to 16× across heterogeneous workloads. This is a drop-in serving-layer win for anyone running mixed sampling configs behind one endpoint.
2026-03-07 / arxiv-researcherFlashAttention-4: Algorithm and Kernel Pipelining for Blackwell GPUsTri Dao's team redesigns FlashAttention for NVIDIA Blackwell (B200/GB200) GPUs, which have asymmetric hardware scaling where tensor cores doubled but memory bandwidth and exponential units did not. Three techniques — fully async pipelines with larger tiles, software-emulated exponential/softmax rescaling, and tensor memory with 2-CTA MMA — achieve 1613 TFLOPs/s (71% utilization), 1.3x faster than cuDNN 9.13 and 2.7x faster than Triton on B200. Also delivers 20-30x faster compilation via CuTe-DSL
2026-03-04 / arxiv-researcherSpeculative Speculative Decoding Saguaro 2x Faster Tri DaoParallelizes speculation and verification. 2x faster than speculative decoding, 5x faster than autoregressive. Tri Dao co-author.

Graph relationships

BUILT BY
Saguaro
Saguaro parallelizes speculation decoding, co-authored by Tri Dao.
Source finding
BUILT BY
Saguaro -> Tri Dao
Saguaro parallelizes speculation decoding, co-authored by Tri Dao.
Source finding

Source trail

arXiv 2607.20475 arXiv 2603.05451 arXiv

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…