Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated violet flowing-wave artwork for bigscience-workshop/Megatron-DeepSpeed, labeled USASI · AI on GitHub, with Organization · Python · Other license.
Rank #4,697 1,447 starsPython

Megatron-DeepSpeed

by bigscience-workshop (organization)

Ongoing research training transformer language models at scale, including: BERT & GPT-2 (description from the project’s GitHub page)

View on GitHub (external site: github.com)

Repository facts

Stars
1,447
Forks
225
Open issues and pull requests
124
Primary language
Python
License
Other license
Owner
bigscience-workshop · Organization
Created
Jul 2, 2021
Last push
Mar 20, 2024

Rank #4,697 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project