
opencompass
by open-compass (organization)
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety. (description from the project’s GitHub page)
Repository facts
- Stars
- 7,527
- Forks
- 896
- Open issues and pull requests
- 378
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- open-compass · Organization
- Created
- Jun 15, 2023
- Last push
- Oct 16, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 314: promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative confi…
26,109 starsTypeScriptMITLast push Oct 18, 2026
Rank 5,225: chunxiaoxx/nautilus-compass
Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
1,254 starsPythonOther licenseLast push Oct 18, 2026
Rank 5,837: TIGER-AI-Lab/ClawBench
Open-source benchmark for browser AI agents on daily tasks.
1,071 starsPythonApache-2.0Last push Oct 17, 2026
Rank 7,389: ModelTC/LightCompress
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
751 starsPythonApache-2.0Last push May 14, 2026
Rank 8,237: HowieHwong/TrustLLM
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs an…
632 starsPythonMITLast push Oct 4, 2026
Rank 8,856: facebookresearch/meta-agents-research-environments
Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces ev…
567 starsPythonMITLast push Sep 30, 2026