
petals
by bigscience-workshop (organization)
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading (description from the project’s GitHub page)
Repository facts
- Stars
- 10,639
- Forks
- 651
- Open issues and pull requests
- 114
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- bigscience-workshop · Organization
- Created
- Jun 12, 2022
- Last push
- Sep 7, 2024
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,898: hiyouga/FastEdit
🩹Editing large language models within 10 seconds⚡
1,369 starsPythonApache-2.0Last push Aug 13, 2023
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 3,021: X-PLUG/mPLUG-Owl
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
2,539 starsPythonMITLast push Apr 2, 2025
Rank 6,220: kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
971 starsPythonMITLast push Nov 6, 2023
Rank 6,577: explosion/curated-transformers
🤖 A PyTorch library of curated Transformer models and their composable components
890 starsPythonMITLast push Apr 17, 2024
Rank 4,832: explosion/spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
1,397 starsPythonMITLast push Sep 27, 2026