semantic-router

Repository facts

Stars

6,206

Forks

1,055

Open issues and pull requests

615

Primary language

Go

License

Apache License 2.0 (Apache-2.0)

Owner

vllm-project · Organization

Created

Aug 26, 2025

Last push

Oct 18, 2026

Topics

• ai-gateway
• guardrails
• inference
• kubernetes
• llm
• llmrouter
• mixture-of-models
• pytorch
• semantic-router
• transformer
• vllm

Rank #1,308 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,348

  Rank 3,348: theagentrouter/agent-router

  Manages Unified Access to Generative AI Services built on Envoy Gateway

  2,240 starsGoApache-2.0Last push Oct 16, 2026

• 4,191

  Rank 4,191: theopenco/llmgateway

  Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

  1,690 starsTypeScriptOther licenseLast push Oct 18, 2026

• 2,619

  Rank 2,619: vllm-project/vllm-ascend

  Community maintained hardware plugin for vLLM on Huawei Ascend

  2,996 starsPythonApache-2.0Last push Oct 18, 2026

• 7,753

  Rank 7,753: microsoft/vidur

  Accurate, large-scale, and extensible simulator for LLM inference Systems

  698 starsPythonMITLast push Aug 24, 2026

• 669

  Rank 669: LMCache/LMCache

  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  12,108 starsPythonApache-2.0Last push Oct 18, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026