local-attention

Repository facts

Stars

504

Forks

52

Open issues and pull requests

11

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

Jul 5, 2020

Last push

Jul 16, 2025

Topics

• artificial-intelligence
• attention-mechanisms
• deep-learning

Rank #9,461 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,035

  Rank 1,035: lucidrains/PaLM-rlhf-pytorch

  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  7,858 starsPythonMITLast push Sep 20, 2026

• 2,393

  Rank 2,393: lucidrains/musiclm-pytorch

  Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

  3,293 starsPythonMITLast push Sep 6, 2023

• 2,936

  Rank 2,936: lucidrains/audiolm-pytorch

  Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

  2,625 starsPythonMITLast push Jan 12, 2025

• 3,573

  Rank 3,573: lucidrains/toolformer-pytorch

  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

  2,063 starsPythonMITLast push Jul 22, 2024

• 3,674

  Rank 3,674: lucidrains/make-a-video-pytorch

  Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

  1,989 starsPythonMITLast push May 3, 2024

• 4,168

  Rank 4,168: lucidrains/alphafold3-pytorch

  Implementation of Alphafold 3 from Google Deepmind in Pytorch

  1,699 starsPythonMITLast push Aug 10, 2026