BS-RoFormer

Repository facts

Stars

987

Forks

49

Open issues and pull requests

14

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

Sep 9, 2023

Last push

Jun 14, 2026

Topics

• artificial-intelligence
• attention-mechanisms
• deep-learning
• music-source-separation
• transformers

Rank #6,162 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,035

  Rank 1,035: lucidrains/PaLM-rlhf-pytorch

  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  7,858 starsPythonMITLast push Sep 20, 2026

• 2,393

  Rank 2,393: lucidrains/musiclm-pytorch

  Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

  3,293 starsPythonMITLast push Sep 6, 2023

• 2,936

  Rank 2,936: lucidrains/audiolm-pytorch

  Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

  2,625 starsPythonMITLast push Jan 12, 2025

• 3,573

  Rank 3,573: lucidrains/toolformer-pytorch

  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

  2,063 starsPythonMITLast push Jul 22, 2024

• 4,168

  Rank 4,168: lucidrains/alphafold3-pytorch

  Implementation of Alphafold 3 from Google Deepmind in Pytorch

  1,699 starsPythonMITLast push Aug 10, 2026

• 6,451

  Rank 6,451: lucidrains/muse-maskgit-pytorch

  Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

  916 starsPythonMITLast push Feb 29, 2024