deepeval

Repository facts

Stars

18,936

Forks

2,091

Open issues and pull requests

745

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

confident-ai · Organization

Created

Aug 10, 2023

Last push

Oct 16, 2026

Topics

• evaluation-framework
• evaluation-metrics
• llm-evaluation
• llm-evaluation-framework
• llm-evaluation-metrics
• python

Rank #430 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 314

  Rank 314: promptfoo/promptfoo

  Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative confi…

  26,109 starsTypeScriptMITLast push Oct 18, 2026

• 9,325

  Rank 9,325: relari-ai/continuous-eval

  Data-Driven Evaluation for LLM-Powered Applications

  519 starsPythonApache-2.0Last push Aug 10, 2026

• 3,621

  Rank 3,621: msoedov/agentic_security

  Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

  2,021 starsPythonApache-2.0Last push Oct 18, 2026

• 2,996

  Rank 2,996: huggingface/lighteval

  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

  2,564 starsPythonMITLast push Oct 6, 2026

• 3,430

  Rank 3,430: future-agi/future-agi

  Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-host…

  2,175 starsPythonApache-2.0Last push Oct 18, 2026

• 1,547

  Rank 1,547: Kiln-AI/Kiln

  Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

  5,197 starsPythonOther licenseLast push Oct 17, 2026