llm-compressor

Repository facts

Stars

3,884

Forks

697

Open issues and pull requests

115

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

vllm-project · Organization

Created

Jun 20, 2024

Last push

Oct 17, 2026

Topics

• compression
• quantization

Rank #2,035 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 2,845

  Rank 2,845: qualcomm/aimet

  AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

  2,729 starsPythonOther licenseLast push Oct 17, 2026

• 4,428

  Rank 4,428: tensorflow/model-optimization

  A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

  1,580 starsPythonApache-2.0Last push Oct 14, 2026

• 5,380

  Rank 5,380: openvinotoolkit/nncf

  Neural Network Compression Framework for enhanced OpenVINO™ inference

  1,209 starsPythonApache-2.0Last push Oct 14, 2026

• 63

  Rank 63: headroomlabs-ai/headroom

  Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP s…

  75,783 starsPythonApache-2.0Last push Oct 17, 2026

• 141

  Rank 141: deepspeedai/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  43,242 starsPythonApache-2.0Last push Oct 18, 2026

• 624

  Rank 624: PaddlePaddle/PaddleNLP

  Easy-to-use and powerful LLM and SLM library with awesome model zoo.

  12,977 starsPythonApache-2.0Last push May 23, 2026