
Rank #1,199 6,758 starsPython
LLMLingua
by microsoft (organization)
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss. (description from the project’s GitHub page)
Repository facts
- Stars
- 6,758
- Forks
- 440
- Open issues and pull requests
- 125
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- microsoft · Organization
- Created
- Jul 7, 2023
- Last push
- Sep 10, 2026