evalscope

Repository facts

Stars

3,557

Forks

527

Open issues and pull requests

30

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

modelscope · Organization

Created

Dec 7, 2023

Last push

Oct 17, 2026

Topics

• evaluation
• llm
• performance
• rag
• vlm

Rank #2,203 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,418

  Rank 1,418: OpenBMB/UltraRAG

  A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

  5,730 starsPythonApache-2.0Last push Oct 18, 2026

• 2,905

  Rank 2,905: om-ai-lab/OmAgent

  [EMNLP-2024] Build multimodal language agents for fast prototype and production

  2,669 starsPythonApache-2.0Last push Oct 16, 2026

• 5,225

  Rank 5,225: chunxiaoxx/nautilus-compass

  Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

  1,254 starsPythonOther licenseLast push Oct 18, 2026

• 6,970

  Rank 6,970: DocAILab/XRAG

  XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

  819 starsPythonApache-2.0Last push Oct 11, 2026

• 208

  Rank 208: Tencent/WeKnora

  Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

  34,598 starsGoOther licenseLast push Oct 18, 2026

• 314

  Rank 314: promptfoo/promptfoo

  Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative confi…

  26,109 starsTypeScriptMITLast push Oct 18, 2026