
SageAttention
by thu-ml (organization)
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models. (description from the project’s GitHub page)
Repository facts
- Stars
- 3,971
- Forks
- 531
- Open issues and pull requests
- 213
- Primary language
- Cuda
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- thu-ml · Organization
- Created
- Oct 3, 2024
- Last push
- Jan 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 2,688: nunchux-ai/ComfyUI-nunchaku
ComfyUI Plugin of Nunchaku
2,933 starsPythonApache-2.0Last push Sep 6, 2026
Rank 4,385: RightNow-AI/autokernel
Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels.
1,599 starsPythonMITLast push Mar 19, 2026
Rank 8,477: BobMcDear/attorch
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
605 starsPythonMITLast push Aug 14, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 6,027: mw00/project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…
1,023 starsC++MITLast push Oct 16, 2026
Rank 1,209: flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
6,687 starsCudaApache-2.0Last push Oct 18, 2026