
Rank #4,187 1,692 starsPython
exllamav3
by turboderp-org (organization)
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs (description from the project’s GitHub page)
Repository facts
- Stars
- 1,692
- Forks
- 255
- Open issues and pull requests
- 75
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- turboderp-org · Organization
- Created
- Apr 6, 2025
- Last push
- Oct 18, 2026