
Zyda-2
by Zyphra (organization)
Zyda-2 is a 5 trillion token language modeling dataset created by collecting open and high quality datasets and combining them and cross-deduplication and model-based quality filtering. Zyda-2 comprises diverse sources of web data, highly educational content, math, code, and… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- Zyphra/Zyda-2
- Likes
- 101
- Downloads (last 30 days)
- 27,356
- Tasks
- Text generation
- Modality
- Not given
- Size
- More than 1T examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- Zyphra · Organization
- Languages
- en
- Created
- Sep 13, 2024
- Last modified
- Aug 6, 2025
More datasets from Zyphra
Rank 805: Zyphra/Zyda
Zyda is a 1.3T language modeling dataset created by collecting open and high quality datasets and combining them and performing a uniform filtering and deduplication ste…
84 likes10,883 downloads in the last 30 daysText generationODC-By