Megatron-LM

Repository facts

Stars

18,188

Forks

4,634

Open issues and pull requests

1,651

Primary language

Python

License

Other license

Owner

NVIDIA · Organization

Created

Mar 21, 2019

Last push

Oct 18, 2026

Topics

• large-language-models
• model-para
• transformers

Rank #450 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026

• 618

  Rank 618: neuml/txtai

  💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  13,024 starsPythonApache-2.0Last push Oct 16, 2026

• 660

  Rank 660: FareedKhan-dev/train-llm-from-scratch

  A straightforward method for training your LLM, from downloading data to generating text.

  12,176 starsPythonMITLast push Oct 2, 2026

• 811

  Rank 811: OpenRLHF/OpenRLHF

  An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

  10,095 starsPythonApache-2.0Last push Oct 5, 2026

• 1,323

  Rank 1,323: amazon-science/chronos-forecasting

  Chronos: Pretrained Models for Time Series Forecasting

  6,135 starsPythonApache-2.0Last push Oct 5, 2026

• 1,473

  Rank 1,473: imoneoi/openchat

  OpenChat: Advancing Open-source Language Models with Imperfect Data

  5,484 starsPythonApache-2.0Last push Sep 13, 2024