auto-round

Repository facts

Stars

1,661

Forks

189

Open issues and pull requests

122

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

intel · Organization

Created

Jan 4, 2024

Last push

Oct 18, 2026

Topics

• diffusers
• gguf
• int4
• llms
• mxfp4
• nvfp4
• omni
• quantization
• rounding
• sglang
• transformers
• vllm
• vlms

Rank #4,252 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 5,162

  Rank 5,162: ModelCloud/GPTQModel

  LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

  1,274 starsPythonOther licenseLast push Oct 18, 2026

• 980

  Rank 980: ai-dynamo/dynamo

  A Datacenter Scale Distributed Inference Serving Framework

  8,328 starsRustOther licenseLast push Oct 18, 2026

• 8,304

  Rank 8,304: huggingface/optimum-intel

  🤗 Optimum Intel: Accelerate inference with Intel optimization tools

  623 starsJupyter NotebookApache-2.0Last push Oct 15, 2026

• 6,932

  Rank 6,932: whitecircle/halo

  Halo is an open-source framework built by White Circle for training large language and multimodal models

  825 starsPythonOther licenseLast push Oct 15, 2026

• 2,853

  Rank 2,853: intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

  2,722 starsPythonApache-2.0Last push Oct 16, 2026