vidur

Repository facts

Stars

698

Forks

139

Open issues and pull requests

24

Primary language

Python

License

MIT License (MIT)

Owner

microsoft · Organization

Created

Nov 2, 2023

Last push

Aug 24, 2026

Topics

• inference
• llm
• simulation
• transformer
• vllm

Rank #7,753 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 2,619

  Rank 2,619: vllm-project/vllm-ascend

  Community maintained hardware plugin for vLLM on Huawei Ascend

  2,996 starsPythonApache-2.0Last push Oct 18, 2026

• 1,308

  Rank 1,308: vllm-project/semantic-router

  An open, programmable decision layer for models and compute.

  6,206 starsGoApache-2.0Last push Oct 18, 2026

• 669

  Rank 669: LMCache/LMCache

  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  12,108 starsPythonApache-2.0Last push Oct 18, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 2,117

  Rank 2,117: PaddlePaddle/FastDeploy

  High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

  3,721 starsPythonApache-2.0Last push Sep 24, 2026