
rotary-embedding-torch
by lucidrains (personal account)
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch (description from the project’s GitHub page)
Repository facts
- Stars
- 828
- Forks
- 69
- Open issues and pull requests
- 27
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- lucidrains · Personal account
- Created
- Jun 29, 2021
- Last push
- Jun 20, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 8,265: therealoliver/Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
629 starsJupyter NotebookMITLast push Feb 24, 2025
Rank 216: explosion/spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
33,968 starsPythonMITLast push Oct 12, 2026
Rank 246: Lightning-AI/pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
31,416 starsPythonApache-2.0Last push Oct 12, 2026
Rank 370: huggingface/datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
22,065 starsPythonApache-2.0Last push Oct 16, 2026
Rank 382: onnx/onnx
Open standard for machine learning interoperability
21,597 starsPythonApache-2.0Last push Oct 18, 2026
Rank 457: camel-ai/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
17,926 starsPythonApache-2.0Last push Oct 12, 2026