
Rank #3,982 1,800 starsPython
turboquant
by 0xSero (personal account)
TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration (description from the project’s GitHub page)
Repository facts
- Stars
- 1,800
- Forks
- 199
- Open issues and pull requests
- 8
- Primary language
- Python
- License
- GNU General Public License v3.0 (GPL-3.0)
- Owner
- 0xSero · Personal account
- Created
- Mar 25, 2026
- Last push
- Sep 3, 2026