Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated green circuit-trace artwork for qiuzh20/gated_attention, labeled USASI · AI on GitHub, with Personal account · Jupyter Notebook · MIT.
Rank #6,164 987 starsJupyter Notebook

gated_attention

by qiuzh20 (personal account)

The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free (description from the project’s GitHub page)

View on GitHub (external site: github.com)

Repository facts

Stars
987
Forks
61
Open issues and pull requests
1
Primary language
Jupyter Notebook
License
MIT License (MIT)
Owner
qiuzh20 · Personal account
Created
May 9, 2025
Last push
Dec 20, 2025

Rank #6,164 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project