RETRO-pytorch

Repository facts

Stars

878

Forks

108

Open issues and pull requests

17

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

lucidrains · Personal account

Created

Jan 15, 2022

Last push

Oct 30, 2023

Topics

• artificial-intelligence
• attention-mechanism
• deep-learning
• retrieval
• transformers

Rank #6,643 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 8,116

  Rank 8,116: lucidrains/memorizing-transformers-pytorch

  Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

  647 starsPythonMITLast push Jul 17, 2023

• 1,367

  Rank 1,367: lucidrains/x-transformers

  A concise but complete full-attention transformer with a set of promising experimental features from various papers

  5,959 starsPythonMITLast push Oct 16, 2026

• 1,442

  Rank 1,442: lucidrains/DALLE-pytorch

  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

  5,627 starsPythonMITLast push Feb 17, 2024

• 4,506

  Rank 4,506: lucidrains/soundstorm-pytorch

  Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

  1,545 starsPythonMITLast push Apr 24, 2025

• 5,194

  Rank 5,194: lucidrains/flamingo-pytorch

  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

  1,267 starsPythonMITLast push Oct 18, 2022

• 5,360

  Rank 5,360: The-AI-Summer/self-attention-cv

  Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

  1,214 starsPythonMITLast push Sep 14, 2021