pytorch-original-transformer
by gordicaleksa (personal account)
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,117
- Forks
- 188
- Open issues and pull requests
- 9
- Primary language
- Jupyter Notebook
- License
- MIT License (MIT)
- Owner
- gordicaleksa · Personal account
- Created
- Oct 19, 2020
- Last push
- Dec 27, 2020
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 5,360: The-AI-Summer/self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
1,214 starsPythonMITLast push Sep 14, 2021
Rank 2,884: gordicaleksa/pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention m…
2,688 starsJupyter NotebookMITLast push Nov 17, 2022
Rank 2,753: linto-ai/whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
2,855 starsPythonAGPL-3.0Last push Sep 28, 2026
Rank 5,352: awslabs/sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
1,216 starsPythonApache-2.0Last push Oct 24, 2024
Rank 9,379: WenjieDu/SAITS
The official PyTorch implementation of the paper "SAITS: Self-Attention-based Imputation for Time Series". A fast and state-of-the-art (SOTA) deep-learning neural network model fo…
513 starsPythonMITLast push Aug 25, 2026
Rank 6,742: jeya-maria-jose/Medical-Transformer
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
860 starsPythonMITLast push Feb 23, 2023