optimum-quanto

Repository facts

Stars

1,053

Forks

96

Open issues and pull requests

6

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

huggingface · Organization

Created

Sep 19, 2023

Last push

Oct 14, 2026

Topics

• optimum
• pytorch
• quantization

Rank #5,911 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 5,162

  Rank 5,162: ModelCloud/GPTQModel

  LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

  1,274 starsPythonOther licenseLast push Oct 18, 2026

• 959

  Rank 959: bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  8,526 starsPythonMITLast push Sep 7, 2026

• 2,236

  Rank 2,236: huggingface/optimum

  🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

  3,504 starsPythonApache-2.0Last push Oct 6, 2026

• 2,609

  Rank 2,609: pytorch/ao

  PyTorch native quantization for training and inference

  3,005 starsPythonOther licenseLast push Oct 16, 2026

• 2,850

  Rank 2,850: aaron-xichen/pytorch-playground

  Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

  2,723 starsPythonMITLast push Nov 22, 2022

• 3,232

  Rank 3,232: dvmazur/mixtral-offloading

  Run Mixtral-8x7B models in Colab or consumer desktops

  2,336 starsPythonMITLast push Apr 8, 2024