Mooncake

Repository facts

Stars

6,826

Forks

1,349

Open issues and pull requests

775

Primary language

C++

License

Apache License 2.0 (Apache-2.0)

Owner

kvcache-ai · Organization

Created

Jun 25, 2024

Last push

Oct 18, 2026

Topics

• disaggregation
• inference
• kvcache
• llm
• rdma
• reinforcement-learning
• sglang
• tokenspeed
• trt-llm
• vllm

Rank #1,183 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,967

  Rank 3,967: ovg-project/kvcached

  Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

  1,807 starsPythonApache-2.0Last push Oct 18, 2026

• 8,348

  Rank 8,348: smg-project/smg

  Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV ca…

  618 starsRustApache-2.0Last push Oct 18, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 9,093

  Rank 9,093: spark-arena/sparkrun

  sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

  543 starsPythonApache-2.0Last push Oct 18, 2026