Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated pink constellation network artwork for stanford-crfm/helm, labeled USASI · AI on GitHub, with Organization · Python · Apache-2.0.
Rank #2,676 2,949 starsPython

helm

by stanford-crfm (organization)

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models. (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: crfm.stanford.edu)

In the USASI catalog: HELM (Holistic Evaluation of Language Models)

Repository facts

Stars
2,949
Forks
425
Open issues and pull requests
117
Primary language
Python
License
Apache License 2.0 (Apache-2.0)
Owner
stanford-crfm · Organization
Created
Nov 29, 2021
Last push
Sep 1, 2026

Rank #2,676 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project