Rank #5,553 1,157 starsPython
vLLM-2080Ti-Definitive
by weicj (personal account)
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord //discord.gg/VFqVVySdMS ) (description from the project’s GitHub page)
Repository facts
- Stars
- 1,157
- Forks
- 158
- Open issues and pull requests
- 41
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- weicj · Personal account
- Created
- Jun 2, 2026
- Last push
- Oct 1, 2026