ServerlessLLM

Repository facts

Stars

718

Forks

78

Open issues and pull requests

46

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

ServerlessLLM · Organization

Created

Jan 23, 2024

Last push

Sep 4, 2026

Topics

• cuda
• huggingface-transformers
• large-language-models
• model-as-a-service
• model-serving
• pytorch
• serverless-inference

Rank #7,611 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 9,341

  Rank 9,341: ome-projects/ome

  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

  517 starsGoApache-2.0Last push Oct 18, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 4,512

  Rank 4,512: sgl-project/sglang-omni

  SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

  1,543 starsPythonApache-2.0Last push Oct 18, 2026

• 6,501

  Rank 6,501: zhihu/ZhiLight

  A highly optimized LLM inference acceleration engine for Llama and its variants.

  907 starsC++Apache-2.0Last push Mar 18, 2026

• 1,323

  Rank 1,323: amazon-science/chronos-forecasting

  Chronos: Pretrained Models for Time Series Forecasting

  6,135 starsPythonApache-2.0Last push Oct 5, 2026

• 3,236

  Rank 3,236: refuel-ai/autolabel

  Label, clean and enrich text datasets with LLMs.

  2,330 starsPythonMITLast push Mar 5, 2025