Pretrained-Language-Model

Repository facts

Stars

3,166

Forks

638

Open issues and pull requests

109

Primary language

Python

License

No license file detected

Owner

huawei-noah · Organization

Created

Dec 2, 2019

Last push

Jan 22, 2024

Topics

• knowledge-distillation
• large-scale-distributed
• model-compression
• pretrained-models
• quantization

Rank #2,484 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,652

  Rank 3,652: haitongli/knowledge-distillation-pytorch

  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

  1,999 starsPythonMITLast push Mar 25, 2023

• 4,673

  Rank 4,673: microsoft/NeuronBlocks

  NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

  1,456 starsPythonMITLast push Jul 22, 2023

• 3,322

  Rank 3,322: 666DZY666/micronet

  micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for…

  2,262 starsPythonMITLast push May 6, 2025

• 4,428

  Rank 4,428: tensorflow/model-optimization

  A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

  1,580 starsPythonApache-2.0Last push Oct 14, 2026

• 7,567

  Rank 7,567: SqueezeAILab/SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  724 starsPythonMITLast push Aug 13, 2024

• 1,811

  Rank 1,811: huawei-noah/Efficient-AI-Backbones

  Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

  4,424 starsPythonNo license file detectedLast push Mar 15, 2025