
MMMU
by MMMU-Benchmark (organization)
This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI" (description from the project’s GitHub page)
Repository facts
- Stars
- 598
- Forks
- 56
- Open issues and pull requests
- 48
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- MMMU-Benchmark · Organization
- Created
- Nov 23, 2023
- Last push
- Jul 28, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 2,809: autodistill/autodistill
Images to inference with no labeling (use foundation models to train supervised models).
2,791 starsPythonApache-2.0Last push Sep 29, 2026
Rank 8,067: pliang279/MultiBench
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
654 starsHTMLMITLast push Jan 27, 2024
Rank 3,741: kyegomez/BitNet
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
1,947 starsPythonMITLast push Oct 12, 2026
Rank 5,986: ArrowLuo/CLIP4Clip
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
1,034 starsPythonMITLast push Apr 12, 2024
Rank 1,358: paperswithcode/ai-deadlines
AI conference deadline countdowns
6,009 starsJavaScriptMITLast push Sep 15, 2024
Rank 895: activeloopai/deeplake
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
9,253 starsC++Apache-2.0Last push May 21, 2026