knowledge-distillation-pytorch

Repository facts

Stars

1,999

Forks

350

Open issues and pull requests

20

Primary language

Python

License

MIT License (MIT)

Owner

haitongli · Personal account

Created

Mar 9, 2018

Last push

Mar 25, 2023

Topics

• cifar10
• computer-vision
• dark-knowledge
• deep-neural-networks
• knowledge-distillation
• model-compression
• pytorch

Rank #3,652 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,276

  Rank 6,276: MingSun-Tse/Efficient-Deep-Learning

  Collection of recent methods on (deep) neural network compression and acceleration.

  959 starsMITLast push Apr 4, 2025

• 4,309

  Rank 4,309: yoshitomo-matsubara/torchdistill

  A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurI…

  1,634 starsPythonMITLast push Oct 12, 2026

• 4,673

  Rank 4,673: microsoft/NeuronBlocks

  NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

  1,456 starsPythonMITLast push Jul 22, 2023

• 7,758

  Rank 7,758: huyvnphan/PyTorch_CIFAR10

  Pretrained TorchVision models on CIFAR10 dataset (with weights)

  697 starsPythonMITLast push Jun 24, 2023

• 6,633

  Rank 6,633: alibaba/TinyNeuralNetwork

  TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

  880 starsPythonMITLast push Mar 3, 2026

• 6,540

  Rank 6,540: megvii-research/mdistiller

  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.…

  899 starsPythonNo license file detectedLast push Nov 5, 2023