
neural-compressor
by intel (organization)
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime (description from the project’s GitHub page)
Repository facts
- Stars
- 2,722
- Forks
- 331
- Open issues and pull requests
- 34
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- intel · Organization
- Created
- Jul 21, 2020
- Last push
- Oct 16, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,389: ModelTC/LightCompress
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
751 starsPythonApache-2.0Last push May 14, 2026
Rank 3,322: 666DZY666/micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for…
2,262 starsPythonMITLast push May 6, 2025
Rank 5,380: openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
1,209 starsPythonApache-2.0Last push Oct 14, 2026
Rank 6,633: alibaba/TinyNeuralNetwork
TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.
880 starsPythonMITLast push Mar 3, 2026
Rank 4,428: tensorflow/model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
1,580 starsPythonApache-2.0Last push Oct 14, 2026
Rank 7,567: SqueezeAILab/SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
724 starsPythonMITLast push Aug 13, 2024