lighteval

Repository facts

Stars

2,564

Forks

582

Open issues and pull requests

445

Primary language

Python

License

MIT License (MIT)

Owner

huggingface · Organization

Created

Jan 26, 2024

Last push

Oct 6, 2026

Topics

• evaluation
• evaluation-framework
• evaluation-metrics
• huggingface

Rank #2,996 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 430

  Rank 430: confident-ai/deepeval

  The LLM Evaluation Framework

  18,936 starsPythonApache-2.0Last push Oct 16, 2026

• 9,325

  Rank 9,325: relari-ai/continuous-eval

  Data-Driven Evaluation for LLM-Powered Applications

  519 starsPythonApache-2.0Last push Aug 10, 2026

• 3,900

  Rank 3,900: xinshuoweng/AB3DMOT

  (IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"

  1,846 starsPythonOther licenseLast push Apr 3, 2024

• 1,547

  Rank 1,547: Kiln-AI/Kiln

  Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

  5,197 starsPythonOther licenseLast push Oct 17, 2026

• 3,588

  Rank 3,588: Cloud-CV/EvalAI

  Evaluating state of the art in AI

  2,047 starsPythonOther licenseLast push Oct 8, 2026

• 314

  Rank 314: promptfoo/promptfoo

  Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative confi…

  26,109 starsTypeScriptMITLast push Oct 18, 2026