llm-d

Repository facts

Stars

4,856

Forks

858

Open issues and pull requests

100

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

llm-d · Organization

Created

Apr 29, 2025

Last push

Oct 18, 2026

Topics

• ai
• cncf
• distributed-inference
• gpu
• inference
• intelligent-routing
• kubernetes
• llm
• model-server

Rank #1,655 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,293

  Rank 3,293: dstackai/dstack

  A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clus…

  2,284 starsPythonMPL-2.0Last push Oct 17, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 8,576

  Rank 8,576: Nehanth/pooled

  Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

  596 starsJavaScriptMITLast push Oct 16, 2026

• 3,339

  Rank 3,339: kubeflow/trainer

  Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

  2,249 starsGoApache-2.0Last push Oct 16, 2026

• 3,348

  Rank 3,348: theagentrouter/agent-router

  Manages Unified Access to Generative AI Services built on Envoy Gateway

  2,240 starsGoApache-2.0Last push Oct 16, 2026

• 9,121

  Rank 9,121: kaito-project/aikit

  🏗️ Fine-tune, build, and deploy open-source LLMs easily!

  539 starsGoMITLast push Oct 12, 2026