self-attention-cv

Repository facts

Stars

1,214

Forks

152

Open issues and pull requests

1

Primary language

Python

License

MIT License (MIT)

Owner

The-AI-Summer · Organization

Created

Jan 31, 2021

Last push

Sep 14, 2021

Topics

• artificial-intelligence
• attention
• attention-mechanism
• deep-learning
• machine-learning
• machine-learning-algorithms
• self-attention
• transformer
• transformers

Rank #5,360 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 9,379

  Rank 9,379: WenjieDu/SAITS

  The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model fo…

  513 starsPythonMITLast push Aug 25, 2026

• 5,672

  Rank 5,672: gordicaleksa/pytorch-original-transformer

  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currentl…

  1,117 starsJupyter NotebookMITLast push Dec 27, 2020

• 5,476

  Rank 5,476: lucidrains/performer-pytorch

  An implementation of Performer, a linear attention-based transformer, in Pytorch

  1,184 starsPythonMITLast push Feb 2, 2022

• 2,884

  Rank 2,884: gordicaleksa/pytorch-GAT

  My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention m…

  2,688 starsJupyter NotebookMITLast push Nov 17, 2022

• 6,742

  Rank 6,742: jeya-maria-jose/Medical-Transformer

  Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

  860 starsPythonMITLast push Feb 23, 2023

• 551

  Rank 551: BlinkDL/RWKV-LM

  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…

  14,748 starsPythonApache-2.0Last push Sep 28, 2026