common_corpus
by PleIAs (organization)
Full paper - ICLR 2026 oral Common Corpus is the largest open licensed text dataset, comprising 2.27 trillion tokens (2,267,302,720,836 tokens). It is a diverse dataset, consisting of books, newspapers, scientific articles, government and legal documents, code, and more. Common… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- PleIAs/common_corpus
- Likes
- 436
- Downloads (last 30 days)
- 131,361
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 10K to 100K examples
- License
- No license given
- Access
- Open download
- Author
- PleIAs · Organization
- Languages
- 13 languages
- Created
- Nov 12, 2024
- Last modified
- May 6, 2026
More datasets from PleIAs
Rank 131: PleIAs/YouTube-Commons
YouTube-Commons is a collection of audio transcripts of 2,063,066 videos shared on YouTube under a CC-By license. Content The collection comprises 22,709,724 original an…
403 likes7,125 downloads in the last 30 daysText generationCC BY 4.0
Rank 198: PleIAs/SYNTH
SYNTH is the first open generalist synthetic dataset for training small reasoning model end-to-end, jointly released by Pleias and the AI Alliance. SYNTH includes 79,648…
302 likes11,403 downloads in the last 30 daysText generationCC BY 4.0
Rank 566: PleIAs/Post-OCR-Correction
Post-OCR correction is a large corpus of 1 billion words containing original texts with a varying number of OCR mistakes and an experimental multilingual post-OCR correc…
135 likes1,076 downloads in the last 30 daysCC0 1.0