vllm

Repository facts

Stars

94,068

Forks

23,543

Open issues and pull requests

9,034

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

vllm-project · Organization

Created

Feb 9, 2023

Last push

Oct 18, 2026

Topics

• amd
• blackwell
• cuda
• deepseek
• deepseek-v3
• gpt
• gpt-oss
• inference
• kimi
• llama
• llm
• llm-serving
• model-serving
• moe
• openai
• pytorch
• qwen
• qwen3
• tpu
• transformer

Rank #43 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 4,833

  Rank 4,833: GradientHQ/parallax

  Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

  1,397 starsPythonApache-2.0Last push Jul 1, 2026

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 513

  Rank 513: modelscope/ms-swift

  Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…

  15,871 starsPythonApache-2.0Last push Oct 18, 2026