flashinfer

Repository facts

Stars

6,687

Forks

1,608

Open issues and pull requests

1,298

Primary language

Cuda

License

Apache License 2.0 (Apache-2.0)

Owner

flashinfer-ai · Organization

Created

Jul 22, 2023

Last push

Oct 18, 2026

Topics

• attention
• cuda
• distributed-inference
• gpu
• jit
• large-large-models
• llm-inference
• moe
• nvidia
• pytorch

Rank #1,209 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026

• 6,027

  Rank 6,027: mw00/project-maya

  Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…

  1,023 starsC++MITLast push Oct 16, 2026

• 770

  Rank 770: NVIDIA/cutlass

  CUDA Templates and Python DSLs for High-Performance Linear Algebra

  10,617 starsC++Other licenseLast push Oct 15, 2026