orpo-dpo-mix-40k
by mlabonne (personal account)
This dataset is designed for ORPO or DPO training. See Fine-tune Llama 3 with ORPO for more information about how to use it. It is a combination of the following high-quality DPO datasets: argilla/Capybara-Preferences: highly scored chosen answers =5 (7,424 samples)… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- mlabonne/orpo-dpo-mix-40k
- Likes
- 314
- Downloads (last 30 days)
- 752
- Tasks
- Text generation
- Modality
- text
- Size
- 10K to 100K examples
- License
- Apache 2.0 (apache-2.0)
- Access
- Open download
- Author
- mlabonne · Personal account
- Languages
- en
- Created
- Apr 17, 2024
- Last modified
- Oct 17, 2024
More datasets from mlabonne
Rank 215: mlabonne/FineTome-100k
The FineTome dataset is a subset of arcee-ai/The-Tome (without arcee-ai/qwen2-72b-magpie-en), re-filtered using HuggingFaceFW/fineweb-edu-classifier. It was made for my…
287 likes24,350 downloads in the last 30 daysNo license given
Rank 367: mlabonne/open-perfectblend
Open-PerfectBlend is an open-source reproduction of the instruction dataset introduced in the paper "The Perfect Blend: Redefining RLHF with Mixture of Judges". It's a s…
194 likes5,557 downloads in the last 30 daysApache 2.0
Rank 433: mlabonne/guanaco-llama2-1k
This is a subset (1000 samples) of the excellent timdettmers/openassistant-guanaco dataset, processed to match Llama 2's prompt format as described in this article. It w…
173 likes1,042 downloads in the last 30 daysNo license given
Rank 447: mlabonne/harmful_behaviors
168 likes30,493 downloads in the last 30 daysNo license given