
vllm-omni
by vllm-project (organization)
A framework for efficient model inference with omni-modality models (description from the project’s GitHub page)
Repository facts
- Stars
- 7,234
- Forks
- 1,922
- Open issues and pull requests
- 1,953
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- vllm-project · Organization
- Created
- Sep 11, 2025
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,512: sgl-project/sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
1,543 starsPythonApache-2.0Last push Oct 18, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 7,042: ChaofanTao/Autoregressive-Models-in-Vision-Survey
[TMLR 2025🔥] A survey for the autoregressive models in vision.
807 starsNo license file detectedLast push May 5, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 3,381: PKU-YuanGroup/Helios
Helios: Real Real-Time Long Video Generation Model
2,212 starsPythonApache-2.0Last push Aug 24, 2026
Rank 6,095: thu-ml/Causal-Forcing
[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++
1,007 starsPythonApache-2.0Last push Oct 3, 2026