
fastT5
by Ki6an (personal account)
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x. (description from the project’s GitHub page)
Repository facts
- Stars
- 586
- Forks
- 76
- Open issues and pull requests
- 27
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Ki6an · Personal account
- Created
- Mar 11, 2021
- Last push
- Apr 24, 2023
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 2,236: huggingface/optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
3,504 starsPythonApache-2.0Last push Oct 6, 2026
Rank 2,553: guillaume-be/rust-bert
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
3,084 starsRustApache-2.0Last push Jan 13, 2026
Rank 6,118: PINTO0309/onnx2tf
A tool for converting ONNX files to LiteRT/TFLite/TensorFlow, PyTorch native code (nn.Module), TorchScript (.pt), state_dict (.pt), Exported Program (.pt2), and Dynamo ONNX. It al…
1,000 starsPythonMITLast push Sep 14, 2026
Rank 5,380: openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
1,209 starsPythonApache-2.0Last push Oct 14, 2026
Rank 7,514: zhiqwang/yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
730 starsPythonGPL-3.0Last push Apr 10, 2026