
Rank #1,732 4,638 starsPython
exllamav2
by turboderp-org (organization)
A fast inference library for running LLMs locally on modern consumer-class GPUs (description from the project’s GitHub page)
Repository facts
- Stars
- 4,638
- Forks
- 347
- Open issues and pull requests
- 162
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- turboderp-org · Organization
- Created
- Aug 30, 2023
- Last push
- Mar 4, 2026