InferenceX

Repository facts

Stars

1,874

Forks

332

Open issues and pull requests

327

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

SemiAnalysisAI · Organization

Created

Jul 12, 2025

Last push

Oct 18, 2026

Topics

• agentic
• agentic-ai
• amd
• benchmarking
• benchmarks
• cuda
• deepseek
• gpu
• inference
• kimi
• llm-inference
• llm-serving
• mlops
• nvidia
• pytorch
• qwen
• rocm
• sglang
• tensorrt-llm
• vllm

Rank #3,852 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 669

  Rank 669: LMCache/LMCache

  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  12,108 starsPythonApache-2.0Last push Oct 18, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 1,372

  Rank 1,372: lemonade-sdk/lemonade

  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

  5,927 starsC++Apache-2.0Last push Oct 18, 2026