Rank #1,847 4,327 starsPython

LightLLM

by ModelTC (organization)

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance. (description from the project’s GitHub page)

View on GitHub

Repository facts

Stars: 4,327
Forks: 375
Open issues and pull requests: 179
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: ModelTC · Organization
Created: Jul 22, 2023
Last push: Oct 18, 2026

Topics

Rank #1,847 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Projects that share this one’s GitHub topics.

Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,923: alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
1,362 starsPythonApache-2.0Last push Oct 18, 2026
Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 768: bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10,639 starsPythonMITLast push Sep 7, 2024
Rank 6,501: zhihu/ZhiLight
A highly optimized LLM inference acceleration engine for Llama and its variants.
907 starsC++Apache-2.0Last push Mar 18, 2026
Rank 2,065: yuanzhoulvpi2017/zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
3,842 starsJupyter NotebookMITLast push Aug 5, 2025

Repository facts

Topics

Related projects

Rank 43: vllm-project/vllm

Rank 4,923: alibaba/rtp-llm

Rank 64: hiyouga/LlamaFactory

Rank 768: bigscience-workshop/petals

Rank 6,501: zhihu/ZhiLight

Rank 2,065: yuanzhoulvpi2017/zero_nlp

Support Us