nano-vllm

Repository facts

Stars

15,956

Forks

2,813

Open issues and pull requests

99

Primary language

Python

License

MIT License (MIT)

Owner

GeeeekExplorer · Personal account

Created

Jun 9, 2025

Last push

Apr 26, 2026

Topics

• deep-learning
• inference
• llm
• nlp
• pytorch
• transformer

Rank #506 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 8,662

  Rank 8,662: Ki6an/fastT5

  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

  586 starsPythonApache-2.0Last push Apr 24, 2023

• 4,492

  Rank 4,492: Tencent/TurboTransformers

  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

  1,550 starsC++Other licenseLast push Jul 18, 2025

• 14

  Rank 14: huggingface/transformers

  🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

  167,814 starsPythonApache-2.0Last push Oct 18, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 9,107

  Rank 9,107: underneathall/pinferencia

  Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  541 starsPythonApache-2.0Last push Feb 14, 2023

• 2,309

  Rank 2,309: superlinked/sie

  Open-source inference server and production cluster for all the models your agent needs.

  3,410 starsPythonApache-2.0Last push Oct 18, 2026