
PaLM-pytorch
by lucidrains (personal account)
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways (description from the project’s GitHub page)
Repository facts
- Stars
- 823
- Forks
- 80
- Open issues and pull requests
- 5
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- lucidrains · Personal account
- Created
- Apr 4, 2022
- Last push
- Nov 9, 2022
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 551: BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…
14,748 starsPythonApache-2.0Last push Sep 28, 2026
Rank 1,367: lucidrains/x-transformers
A concise but complete full-attention transformer with a set of promising experimental features from various papers
5,959 starsPythonMITLast push Oct 16, 2026
Rank 1,442: lucidrains/DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
5,627 starsPythonMITLast push Feb 17, 2024
Rank 2,753: linto-ai/whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
2,855 starsPythonAGPL-3.0Last push Sep 28, 2026
Rank 4,506: lucidrains/soundstorm-pytorch
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
1,545 starsPythonMITLast push Apr 24, 2025
Rank 5,194: lucidrains/flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
1,267 starsPythonMITLast push Oct 18, 2022