
pile
by EleutherAI (organization)
The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together. (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- EleutherAI/pile
- Likes
- 512
- Downloads (last 30 days)
- 8,740
- Tasks
- Text generation, Fill mask
- Modality
- Not given
- Size
- 100B to 1T examples
- License
- Other license
- Access
- Open download
- Author
- EleutherAI · Organization
- Languages
- en
- Created
- Mar 2, 2022
- Last modified
- May 3, 2023
More datasets from EleutherAI
Rank 268: EleutherAI/proof-pile-2
A dataset of high quality mathematical text.
242 likes30,341 downloads in the last 30 daysText generationNo license given
Rank 639: EleutherAI/the_pile_deduplicated
121 likes13,476 downloads in the last 30 daysNo license given
Rank 673: EleutherAI/hendrycks_math
MATH dataset from Citation Information @article{hendrycksmath2021, title={Measuring Mathematical Problem Solving With the MATH Dataset}, author={Dan Hendrycks and Collin…
116 likes141,372 downloads in the last 30 daysMIT
Rank 829: EleutherAI/pile-standard-pythia-preshuffled
5 likes4,740 downloads in the last 30 daysNo license given
Rank 836: EleutherAI/pile_val_test
The Pile: Validation and Test Splits This repo contains the validation and test splits of The Pile, an 825 GiB English text dataset designed for training large language…
0 likes503 downloads in the last 30 daysText generationMIT