MEGABYTE-pytorch

Repository facts

Stars

657

Forks

56

Open issues and pull requests

4

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

May 15, 2023

Last push

Dec 27, 2024

Topics

• artificial-intelligence
• attention-mechanisms
• deep-learning
• learned-tokenization
• long-context
• transformers

Rank #8,040 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,035

  Rank 1,035: lucidrains/PaLM-rlhf-pytorch

  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  7,858 starsPythonMITLast push Sep 20, 2026

• 2,393

  Rank 2,393: lucidrains/musiclm-pytorch

  Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

  3,293 starsPythonMITLast push Sep 6, 2023

• 2,936

  Rank 2,936: lucidrains/audiolm-pytorch

  Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

  2,625 starsPythonMITLast push Jan 12, 2025

• 3,573

  Rank 3,573: lucidrains/toolformer-pytorch

  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

  2,063 starsPythonMITLast push Jul 22, 2024

• 4,168

  Rank 4,168: lucidrains/alphafold3-pytorch

  Implementation of Alphafold 3 from Google Deepmind in Pytorch

  1,699 starsPythonMITLast push Aug 10, 2026

• 6,162

  Rank 6,162: lucidrains/BS-RoFormer

  Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

  987 starsPythonMITLast push Jun 14, 2026