sglang

Repository facts

Stars

37,276

Forks

9,669

Open issues and pull requests

5,899

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

sgl-project · Organization

Created

Jan 8, 2024

Last push

Oct 18, 2026

Topics

• attention
• blackwell
• cuda
• deepseek
• diffusion
• glm
• gpt-oss
• inference
• llama
• llm
• minimax
• moe
• qwen
• qwen-image
• reinforcement-learning
• transformer
• vlm
• wan

Rank #185 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 2,876

  Rank 2,876: lightseekorg/tokenspeed

  TokenSpeed is a speed-of-light LLM inference engine.

  2,699 starsPythonMITLast push Oct 18, 2026

• 4,833

  Rank 4,833: GradientHQ/parallax

  Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

  1,397 starsPythonApache-2.0Last push Jul 1, 2026

• 13

  Rank 13: ollama/ollama

  Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

  183,722 starsGoMITLast push Oct 18, 2026

• 882

  Rank 882: oumi-ai/oumi

  Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

  9,403 starsPythonApache-2.0Last push Oct 15, 2026

• 558

  Rank 558: FlashML-org/FreeToken

  FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

  14,572 starsPythonApache-2.0Last push Oct 18, 2026