Dolci-Instruct-DPO
by allenai (organization)
This dataset is licensed under ODC-BY. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines. The Dolci Instruct DPO mixture was used to preference tune Olmo 3 Instruct 7B. It contains 260,000 preference pairs in total, including… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- allenai/Dolci-Instruct-DPO
- Likes
- 17
- Downloads (last 30 days)
- 1,710
- Tasks
- Not given
- Modality
- text
- Size
- 100K to 1M examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- allenai · Organization
- Languages
- Not given
- Created
- Oct 22, 2025
- Last modified
- Feb 20, 2026
More datasets from allenai
Rank 20: allenai/dolma
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
1,107 likes2,859 downloads in the last 30 daysText generationODC-By
Rank 52: allenai/c4
A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: " This is the processed version of Google's C4 dataset We prepared five va…
688 likes773,370 downloads in the last 30 daysText generationODC-By
Rank 97: allenai/objaverse
Objaverse is a Massive Dataset with 800K+ Annotated 3D Objects. More documentation is coming soon. In the meantime, please see our paper and website for additional detai…
477 likes477,055 downloads in the last 30 daysODC-By
Rank 101: allenai/WildChat-1M
Interactive Search Tool: (paper) License: ODC-BY Language(s) (NLP): multi-lingual Point of Contact: Yuntian Deng Dataset Summary WildChat is a collection of 1 million co…
474 likes36,853 downloads in the last 30 daysText generationODC-By
Rank 121: allenai/ai2_arc
A new dataset of 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset is part…
424 likes601,170 downloads in the last 30 daysQuestion answeringCC BY-SA 4.0
Rank 190: allenai/olmOCR-bench
olmOCR-bench is a dataset of 1,403 PDF files, plus 7,010 unit test cases that capture properties of the output that a good OCR system should have. This benchmark evaluat…
309 likes34,698 downloads in the last 30 daysODC-By