Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI
Generated teal circuit-trace artwork for microsoft/LLMLingua, labeled USASI · AI on GitHub, with Organization · Python · MIT.
Rank #1,199 6,758 starsPython

LLMLingua

by microsoft (organization)

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss. (description from the project’s GitHub page)

Repository facts

Stars
6,758
Forks
440
Open issues and pull requests
125
Primary language
Python
License
MIT License (MIT)
Owner
microsoft · Organization
Created
Jul 7, 2023
Last push
Sep 10, 2026

Rank #1,199 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Support Us

Help keep USASI useful.

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project