memorizing-transformers-pytorch

Repository facts

Stars

647

Forks

49

Open issues and pull requests

10

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

Mar 21, 2022

Last push

Jul 17, 2023

Topics

• approximate-nearest-neighbors
• artificial-intelligence
• attention-mechanism
• deep-learning
• memory
• retrieval
• transformers

Rank #8,116 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,643

  Rank 6,643: lucidrains/RETRO-pytorch

  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

  878 starsPythonApache-2.0Last push Oct 30, 2023

• 1,367

  Rank 1,367: lucidrains/x-transformers

  A concise but complete full-attention transformer with a set of promising experimental features from various papers

  5,959 starsPythonMITLast push Oct 16, 2026

• 1,442

  Rank 1,442: lucidrains/DALLE-pytorch

  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

  5,627 starsPythonMITLast push Feb 17, 2024

• 4,506

  Rank 4,506: lucidrains/soundstorm-pytorch

  Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

  1,545 starsPythonMITLast push Apr 24, 2025

• 5,194

  Rank 5,194: lucidrains/flamingo-pytorch

  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

  1,267 starsPythonMITLast push Oct 18, 2022

• 5,360

  Rank 5,360: The-AI-Summer/self-attention-cv

  Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

  1,214 starsPythonMITLast push Sep 14, 2021