
Sophia
by Liuhong99 (personal account)
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training” (description from the project’s GitHub page)
Repository facts
- Stars
- 1,000
- Forks
- 57
- Open issues and pull requests
- 8
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- Liuhong99 · Personal account
- Created
- May 23, 2023
- Last push
- Jan 30, 2024
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,309: microsoft/Trace
End-to-end Generative Optimization for AI Agents
762 starsPythonMITLast push Jun 17, 2026
Rank 7,557: AGI-Arena/MARS
The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
724 starsPythonApache-2.0Last push Mar 26, 2026
Rank 6,943: sail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
823 starsPythonApache-2.0Last push Jun 8, 2025
Rank 138: ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
44,061 starsPythonApache-2.0Last push Oct 18, 2026
Rank 457: camel-ai/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
17,926 starsPythonApache-2.0Last push Oct 12, 2026
Rank 592: Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
13,715 starsPythonApache-2.0Last push Oct 13, 2026