linear-attention-transformer

Repository facts

Stars

845

Forks

78

Open issues and pull requests

10

Primary language

Python

License

MIT License (MIT)

Owner

lucidrains · Personal account

Created

Jun 4, 2020

Last push

May 5, 2024

Topics

• artificial-intelligence
• attention-mechanism
• deep-learning
• pytorch
• transformer

Rank #6,824 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 551

  Rank 551: BlinkDL/RWKV-LM

  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…

  14,748 starsPythonApache-2.0Last push Sep 28, 2026

• 5,352

  Rank 5,352: awslabs/sockeye

  Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

  1,216 starsPythonApache-2.0Last push Oct 24, 2024

• 5,360

  Rank 5,360: The-AI-Summer/self-attention-cv

  Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

  1,214 starsPythonMITLast push Sep 14, 2021

• 5,744

  Rank 5,744: lucidrains/tab-transformer-pytorch

  Implementation of TabTransformer, attention network for tabular data, in Pytorch

  1,099 starsPythonMITLast push Jan 8, 2026

• 6,179

  Rank 6,179: qinzheng93/GeoTransformer

  [CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration

  984 starsPythonMITLast push Nov 22, 2023

• 7,779

  Rank 7,779: soobinseo/Transformer-TTS

  A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

  695 starsPythonMITLast push Nov 8, 2023