Rank #1,499 5,356 starsPython
Model-Optimizer
by NVIDIA (organization)
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed. (description from the project’s GitHub page)
Repository facts
- Stars
- 5,356
- Forks
- 752
- Open issues and pull requests
- 501
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NVIDIA · Organization
- Created
- Apr 23, 2024
- Last push
- Oct 18, 2026