Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Jump to

Start hereFour ways into the catalogCompanies & LabsU.S. AI organizationsOpen Models & ToolsOpen models, software, datasets, and evaluation toolsLearnExplainers and learning pathsFor kidsAI and Super Intelligence, explained for readers 8 to 12Latest newsSourced news itemsPolicy trackerFederal AI laws, orders, and standards

Generated teal orbit artwork for microsoft/MInference, labeled USASI · AI on GitHub, with Organization · Python · MIT.
Rank #5,301 1,229 starsPython

MInference

by microsoft (organization)

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy. (description from the project’s GitHub page)

View on GitHub (external site: github.com)Homepage (external site: aka.ms)

Repository facts

Stars
1,229
Forks
84
Open issues and pull requests
99
Primary language
Python
License
MIT License (MIT)
Owner
microsoft · Organization
Created
May 22, 2024
Last push
Oct 10, 2026

Rank #5,301 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Leave a tip on Buy Me a Coffee (external site)

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project