FastDeploy

Repository facts

Stars

3,721

Forks

758

Open issues and pull requests

633

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

PaddlePaddle · Organization

Created

Jun 27, 2022

Last push

Sep 24, 2026

Topics

• ernie
• ernie-45
• ernie-45-vl
• inference
• llm
• llm-serving
• openai
• serving
• vllm

Rank #2,117 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 1,048

  Rank 1,048: PaddlePaddle/ERNIE

  The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

  7,737 starsPythonApache-2.0Last push Jul 24, 2026

• 2,619

  Rank 2,619: vllm-project/vllm-ascend

  Community maintained hardware plugin for vLLM on Huawei Ascend

  2,996 starsPythonApache-2.0Last push Oct 18, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026