dynamo

Repository facts

Stars

8,328

Forks

1,721

Open issues and pull requests

2,041

Primary language

Rust

License

Other license

Owner

ai-dynamo · Organization

Created

Mar 3, 2025

Last push

Oct 18, 2026

Topics

• diffusion
• disaggregated-serving
• kubernetes
• llm-inference
• omni
• routing-engine
• rust
• sglang
• tensorrt-llm
• vllm

Rank #980 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 4,252

  Rank 4,252: intel/auto-round

  PTQ-Level Efficiency, QAT-Level Accuracy|训练后量化的效率，量化感知训练的精度

  1,661 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 3,967

  Rank 3,967: ovg-project/kvcached

  Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

  1,807 starsPythonApache-2.0Last push Oct 18, 2026

• 9,341

  Rank 9,341: ome-projects/ome

  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

  517 starsGoApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026