x-transformers

Repository facts

Stars

5,959

Forks

524

Open issues and pull requests

96

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

Oct 24, 2020

Last push

Oct 16, 2026

Topics

• artificial-intelligence
• attention-mechanism
• deep-learning
• transformers

Rank #1,367 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,442

  Rank 1,442: lucidrains/DALLE-pytorch

  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

  5,627 starsPythonMITLast push Feb 17, 2024

• 4,506

  Rank 4,506: lucidrains/soundstorm-pytorch

  Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

  1,545 starsPythonMITLast push Apr 24, 2025

• 5,194

  Rank 5,194: lucidrains/flamingo-pytorch

  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

  1,267 starsPythonMITLast push Oct 18, 2022

• 5,360

  Rank 5,360: The-AI-Summer/self-attention-cv

  Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

  1,214 starsPythonMITLast push Sep 14, 2021

• 5,418

  Rank 5,418: lucidrains/CoCa-pytorch

  Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

  1,201 starsPythonMITLast push Dec 12, 2023

• 5,476

  Rank 5,476: lucidrains/performer-pytorch

  An implementation of Performer, a linear attention-based transformer, in Pytorch

  1,184 starsPythonMITLast push Feb 2, 2022