lm-evaluation-harness

Repository facts

Stars

14,259

Forks

3,692

Open issues and pull requests

1,201

Primary language

Python

License

MIT License (MIT)

Owner

EleutherAI · Organization

Created

Aug 28, 2020

Last push

Sep 14, 2026

Topics

• evaluation-framework
• language-model
• transformer

Rank #573 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 551

  Rank 551: BlinkDL/RWKV-LM

  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…

  14,748 starsPythonApache-2.0Last push Sep 28, 2026

• 963

  Rank 963: OptimalScale/LMFlow

  An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

  8,481 starsPythonApache-2.0Last push Aug 10, 2026

• 1,235

  Rank 1,235: codertimo/BERT-pytorch

  Google AI 2018 BERT pytorch implementation

  6,530 starsPythonApache-2.0Last push Sep 15, 2023

• 3,037

  Rank 3,037: young-geng/EasyLM

  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

  2,515 starsPythonApache-2.0Last push Aug 13, 2024

• 5,132

  Rank 5,132: NVIDIA-Merlin/Transformers4Rec

  Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.

  1,284 starsPythonApache-2.0Last push Aug 23, 2026

• 8,585

  Rank 8,585: hirofumi0810/neural_sp

  End-to-end ASR/LM implementation with PyTorch

  595 starsPythonApache-2.0Last push Aug 30, 2021