DatasetRank #498 of 836 155 likes

minipile

Name: minipile
Creator: JeanKaddour
Keywords: Text generation, Fill mask

by JeanKaddour (personal account)

The MiniPile Challenge for Data-Efficient Language Models Dataset Summary MiniPile is a 6GB subset of the deduplicated The Pile corpus. To curate MiniPile, we perform a simple, three-step data filtering process: we (1) infer embeddings for all documents of the Pile, (2) cluster… (excerpt from the dataset card on Hugging Face)

View on Hugging Face

Dataset facts

Hub id: JeanKaddour/minipile
Likes: 155
Downloads (last 30 days): 2,685
Tasks: Text generation, Fill mask
Modality: text
Size: 1M to 10M examples
License: Other license
Access: Open download
Author: JeanKaddour · Personal account
Languages: en
Created: Apr 9, 2023
Last modified: Jun 20, 2023

Rank #498 of 836 datasets in AI on Hugging Face, by likes. Data from the Hugging Face Hub API, fetched Oct 18, 2026. Likes measure popularity, not quality or safety. Downloads are for the last 30 days, as the Hub reports them; counts change daily. A listing is not an endorsement. How this list is made

Dataset facts

Support Us