langtest

Repository facts

Stars

561

Forks

54

Open issues and pull requests

7

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

PacificAI · Organization

Created

Nov 18, 2022

Last push

Aug 28, 2026

Topics

• ai-safety
• ai-testing
• artificial-intelligence
• benchmark-framework
• benchmarks
• ethics-in-ai
• large-language-models
• llm
• llm-as-evaluator
• llm-evaluation-toolkit
• llm-test
• llm-testing
• ml-safety
• ml-testing
• mlops
• model-assessment
• nlp
• responsible-ai
• trustworthy-ai

Rank #8,915 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,376

  Rank 1,376: Giskard-AI/giskard-oss

  🐢 Open-Source Evaluation & Testing library for LLM Agents

  5,907 starsPythonApache-2.0Last push Oct 16, 2026

• 8,237

  Rank 8,237: HowieHwong/TrustLLM

  [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs an…

  632 starsPythonMITLast push Oct 4, 2026

• 9,244

  Rank 9,244: agencyenterprise/PromptInject

  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper A…

  528 starsPythonMITLast push Apr 27, 2026

• 6,682

  Rank 6,682: georgian-io/LLM-Finetuning-Toolkit

  Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

  870 starsPythonApache-2.0Last push May 4, 2026

• 4,351

  Rank 4,351: MLGroupJLU/LLM-eval-survey

  The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

  1,614 starsNo license file detectedLast push Sep 13, 2026

• 5,781

  Rank 5,781: THU-BPM/MarkLLM

  [EMNLP 2024 Demo] MarkLLM: An Open-Source Toolkit for LLM Watermarking

  1,088 starsPythonApache-2.0Last push Sep 5, 2026