Tri Dao
First author of FlashAttention and co-author of Mamba; Princeton professor and Together AI co-founder
- Assistant Professor of Computer Science, leading the Dao AI Lab, Princeton University12
- Co-founder and Chief Scientist, Together AI1
Tri Dao is an Assistant Professor of Computer Science at Princeton University, where Dao leads the Dao AI Lab, and a co-founder and the Chief Scientist of Together AI; Dao's site describes research on efficient training and inference through hardware-aware algorithms. Dao is first author of the FlashAttention paper and sole author of FlashAttention-2, whose official implementation lists support for consumer GPUs such as the RTX 3090 and RTX 4090. With Albert Gu, Dao co-authored the Mamba and Mamba-2 papers, and the Mamba repository publishes pretrained checkpoints from 130M to 2.8B parameters on Hugging Face under the Apache 2.0 license.1345891012
Work
Mamba and Mamba-2 (external site: github.com)
Co-author with Albert Gu of the Mamba (2023) and Mamba-2 (2024) papers, and listed in the repository's AUTHORS file. The Apache-2.0 repository publishes pretrained Mamba and Mamba-2 checkpoints from 130M to 2.8B parameters on Hugging Face, with model cards under the Apache 2.0 license, and includes a script that downloads a checkpoint from the Hub and generates text.8910111312
FlashAttention (external site: github.com)
First author of the FlashAttention paper (2022) and sole author of FlashAttention-2 (2023). The BSD-3-Clause repository, whose AUTHORS file lists Dao, provides the official implementation; its README lists support for Ampere, Ada, and Hopper GPUs including the RTX 3090 and RTX 4090, and a ROCm version for AMD GPUs.34567
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.