gpustack

Repository facts

Stars

5,844

Forks

687

Open issues and pull requests

683

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

gpustack · Organization

Created

May 11, 2024

Last push

Oct 16, 2026

Topics

• ascend
• cuda
• deepseek
• distributed-inference
• genai
• high-performance-inference
• inference
• llama
• llm
• llm-inference
• llm-serving
• maas
• mindie
• openai
• qwen
• rocm
• sglang
• vllm

Rank #1,389 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 9,341

  Rank 9,341: ome-projects/ome

  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

  517 starsGoApache-2.0Last push Oct 18, 2026

• 1,372

  Rank 1,372: lemonade-sdk/lemonade

  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

  5,927 starsC++Apache-2.0Last push Oct 18, 2026

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026