
OmniVinci
by NVlabs (organization)
OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language. (description from the project’s GitHub page)
Repository facts
- Stars
- 684
- Forks
- 56
- Open issues and pull requests
- 8
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NVlabs · Organization
- Created
- Sep 24, 2025
- Last push
- Aug 31, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 8,800: ictnlp/LLaVA-Mini
LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.
573 starsPythonApache-2.0Last push Jun 29, 2025
Rank 4,701: ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1,444 starsPythonApache-2.0Last push Jun 23, 2026
Rank 4,529: ATH-MaaS/Ovis
A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
1,532 starsPythonApache-2.0Last push Jul 15, 2026
Rank 8,818: cambrian-mllm/cambrian-s
Cambrian-S: Towards Spatial Supersensing in Video
571 starsPythonApache-2.0Last push Apr 3, 2026
Rank 2,502: ictnlp/LLaMA-Omni
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
3,143 starsPythonApache-2.0Last push May 19, 2025
Rank 3,635: cambrian-mllm/cambrian
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
2,011 starsPythonApache-2.0Last push Nov 7, 2025