safe-rlhf

Repository facts

Stars

1,620

Forks

134

Open issues and pull requests

19

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

PKU-Alignment · Organization

Created

May 15, 2023

Last push

Nov 24, 2025

Topics

• ai-safety
• alpaca
• beaver
• datasets
• deepspeed
• gpt
• large-language-models
• llama
• llm
• llms
• reinforcement-learning
• reinforcement-learning-from-human-feedback
• rlhf
• safe-reinforcement-learning
• safe-reinforcement-learning-from-human-feedback
• safe-rlhf
• safety
• transformer
• transformers
• vicuna

Rank #4,338 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026

• 3,021

  Rank 3,021: X-PLUG/mPLUG-Owl

  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

  2,539 starsPythonMITLast push Apr 2, 2025

• 1,146

  Rank 1,146: ymcui/Chinese-LLaMA-Alpaca-2

  中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

  7,103 starsPythonApache-2.0Last push Apr 19, 2026

• 4,811

  Rank 4,811: gotzmann/llama.go

  llama.go is like llama.cpp in pure Golang!

  1,403 starsGoOther licenseLast push Sep 20, 2024

• 811

  Rank 811: OpenRLHF/OpenRLHF

  An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

  10,095 starsPythonApache-2.0Last push Oct 5, 2026

• 6,932

  Rank 6,932: whitecircle/halo

  Halo is an open-source framework built by White Circle for training large language and multimodal models

  825 starsPythonOther licenseLast push Oct 15, 2026