ao

Repository facts

Stars

3,005

Forks

655

Open issues and pull requests

815

Primary language

Python

License

Other license

Owner

pytorch · Organization

Created

Nov 3, 2023

Last push

Oct 16, 2026

Topics

• brrr
• cuda
• dtypes
• float8
• inference
• llama
• mx
• pytorch
• quantization
• sparsity
• training
• transformer

Rank #2,609 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026

• 2,236

  Rank 2,236: huggingface/optimum

  🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

  3,504 starsPythonApache-2.0Last push Oct 6, 2026

• 8,662

  Rank 8,662: Ki6an/fastT5

  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

  586 starsPythonApache-2.0Last push Apr 24, 2023

• 315

  Rank 315: SYSTRAN/faster-whisper

  Faster Whisper transcription with CTranslate2

  25,936 starsPythonMITLast push Oct 16, 2026

• 7,567

  Rank 7,567: SqueezeAILab/SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  724 starsPythonMITLast push Aug 13, 2024