SqueezeLLM

Repository facts

Stars

724

Forks

54

Open issues and pull requests

21

Primary language

Python

License

MIT License (MIT)

Owner

SqueezeAILab · Organization

Created

Jun 12, 2023

Last push

Aug 13, 2024

Topics

• efficient-inference
• large-language-models
• llama
• llm
• localllm
• model-compression
• natural-language-processing
• post-training-quantization
• quantization
• small-models
• text-generation
• transformer

Rank #7,567 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,807

  Rank 3,807: SqueezeAILab/LLMCompiler

  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  1,897 starsPythonMITLast push Jul 10, 2024

• 3,037

  Rank 3,037: young-geng/EasyLM

  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

  2,515 starsPythonApache-2.0Last push Aug 13, 2024

• 3,322

  Rank 3,322: 666DZY666/micronet

  micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for…

  2,262 starsPythonMITLast push May 6, 2025

• 1,811

  Rank 1,811: huawei-noah/Efficient-AI-Backbones

  Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

  4,424 starsPythonNo license file detectedLast push Mar 15, 2025

• 2,853

  Rank 2,853: intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

  2,722 starsPythonApache-2.0Last push Oct 16, 2026

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026