
Zyda
by Zyphra (organization)
Zyda is a 1.3T language modeling dataset created by collecting open and high quality datasets and combining them and performing a uniform filtering and deduplication step. We find that Zyda performs extremely well in ablations and is at least comparable and potentially better… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- Zyphra/Zyda
- Likes
- 84
- Downloads (last 30 days)
- 10,883
- Tasks
- Text generation
- Modality
- text
- Size
- 1B to 10B examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- Zyphra · Organization
- Languages
- en
- Created
- May 4, 2024
- Last modified
- Jun 19, 2024
More datasets from Zyphra
Rank 793: Zyphra/Zyda-2
Zyda-2 is a 5 trillion token language modeling dataset created by collecting open and high quality datasets and combining them and cross-deduplication and model-based qu…
101 likes27,356 downloads in the last 30 daysText generationODC-By