how-to-optim-algorithm-in-cuda

Repository facts

Stars

3,318

Forks

297

Open issues and pull requests

8

Primary language

Cuda

License

No license file detected

Owner

BBuf · Personal account

Created

Jul 18, 2018

Last push

Oct 11, 2026

Topics

• cuda
• llm

Rank #2,375 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,994

  Rank 1,994: thu-ml/SageAttention

  [ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and…

  3,971 starsCudaApache-2.0Last push Jan 17, 2026

• 5,932

  Rank 5,932: NVIDIA/raft

  RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for mo…

  1,047 starsCudaApache-2.0Last push Oct 16, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026

• 669

  Rank 669: LMCache/LMCache

  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  12,108 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026