GPTQModel

Repository facts

Stars

1,274

Forks

211

Open issues and pull requests

31

Primary language

Python

License

Other license

Owner

ModelCloud · Organization

Created

Jun 17, 2024

Last push

Oct 18, 2026

Topics

• gptq
• optimum
• peft
• quantization
• sglang
• transformers
• vllm

Rank #5,162 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,932

  Rank 6,932: whitecircle/halo

  Halo is an open-source framework built by White Circle for training large language and multimodal models

  825 starsPythonOther licenseLast push Oct 15, 2026

• 4,252

  Rank 4,252: intel/auto-round

  PTQ-Level Efficiency, QAT-Level Accuracy|训练后量化的效率，量化感知训练的精度

  1,661 starsPythonApache-2.0Last push Oct 18, 2026

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 2,853

  Rank 2,853: intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

  2,722 starsPythonApache-2.0Last push Oct 16, 2026

• 5,911

  Rank 5,911: huggingface/optimum-quanto

  A pytorch quantization backend for optimum

  1,053 starsPythonApache-2.0Last push Oct 14, 2026