lmms-eval
by EvolvingLMMs-Lab (organization)
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks (description from the project’s GitHub page)
Repository facts
- Stars
- 4,456
- Forks
- 676
- Open issues and pull requests
- 60
- Primary language
- Python
- License
- Other license
- Owner
- EvolvingLMMs-Lab · Organization
- Created
- Mar 7, 2024
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,240: OpenMOSS/MOSS-VL
An open-weight 11B model series for long-form and real-time video understanding
774 starsC++Apache-2.0Last push Oct 14, 2026
Rank 7,101: xinxuxin/keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
799 starsPythonOther licenseLast push Sep 15, 2026
Rank 8,237: HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs an…
632 starsPythonMITLast push Oct 4, 2026
Rank 6,522: EvolvingLMMs-Lab/NEO
NEO Series: Native Vision-Language Models from First Principles
902 starsPythonApache-2.0Last push Jul 27, 2026
Rank 8,544: onyx-dot-app/EnterpriseRAG-Bench
Dataset and benchmark for RAG on company internal documents.
599 starsMITLast push Sep 3, 2026
Rank 3,761: NVIDIA-AI-Blueprints/video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual…
1,931 starsPythonApache-2.0Last push Oct 18, 2026