vllm-ascend

Repository facts

Stars

2,996

Forks

2,480

Open issues and pull requests

4,150

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

vllm-project · Organization

Created

Jan 29, 2025

Last push

Oct 18, 2026

Topics

• inference
• llm
• llm-serving
• llmops
• mlops
• model-serving
• transformer
• vllm

Rank #2,619 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,552

  Rank 3,552: microsoft/aici

  AICI: Prompts as (Wasm) Programs

  2,076 starsRustMITLast push Jan 22, 2025

• 922

  Rank 922: bentoml/BentoML

  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  8,906 starsPythonApache-2.0Last push Oct 5, 2026

• 4,923

  Rank 4,923: alibaba/rtp-llm

  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

  1,362 starsPythonApache-2.0Last push Oct 18, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026