
DatasetRank #50 of 836 701 likes
CulturaX
by uonlp (organization)
Cleaned, Enormous, and Public: The Multilingual Fuel to Democratize Large Language Models for 167 Languages Dataset Summary We present CulturaX, a substantial multilingual dataset with 6.3 trillion tokens in 167 languages, tailored for large language model (LLM) development… (excerpt from the dataset card on Hugging Face)
Access requires accepting terms on Hugging Face.
Dataset facts
- Hub id
- uonlp/CulturaX
- Likes
- 701
- Downloads (last 30 days)
- 25,707
- Tasks
- Text generation, Fill mask
- Modality
- text
- Size
- 1B to 10B examples
- License
- No license given
- Access
- Gated: access is granted on accepting the terms
- Author
- uonlp · Organization
- Languages
- 30 languages
- Created
- Sep 4, 2023
- Last modified
- Dec 16, 2024