aya_dataset
by CohereLabs (organization)
The Aya Dataset is a multilingual instruction fine-tuning dataset curated by an open-science community via Aya Annotation Platform from Cohere Labs. The dataset contains a total of 204k human-annotated prompt-completion pairs along with the demographics data of the annotators… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- CohereLabs/aya_dataset
- Likes
- 378
- Downloads (last 30 days)
- 22,430
- Tasks
- Other
- Modality
- text
- Size
- 100K to 1M examples
- License
- Apache 2.0 (apache-2.0)
- Access
- Open download
- Author
- CohereLabs · Organization
- Languages
- 30 languages
- Created
- Jan 31, 2024
- Last modified
- Apr 15, 2025
More datasets from CohereLabs
Rank 246: CohereLabs/wikipedia-2023-11-embed-multilingual-v3
Multilingual Embeddings for Wikipedia in 300+ Languages This dataset contains the wikimedia/wikipedia dataset dump from 2023-11-01 from Wikipedia in all 300+ languages.…
256 likes4,560 downloads in the last 30 daysNo license given
Rank 261: CohereLabs/aya_collection
This dataset is uploaded in two places: here and additionally here as 'Aya Collection Language Split.' These datasets are identical in content but differ in structure of…
245 likes15,856 downloads in the last 30 daysText classificationApache 2.0
Rank 456: CohereLabs/Global-MMLU
Global-MMLU 🌍 is a multilingual evaluation set spanning 42 languages, including English. This dataset combines machine translations for MMLU questions along with profes…
165 likes31,177 downloads in the last 30 daysApache 2.0
Rank 635: CohereLabs/aya_collection_language_split
This is a re-upload of the aya_collection, and only differs in the structure of upload. While the original aya_collection is structured by folders split according to dat…
122 likes10,363 downloads in the last 30 daysApache 2.0
Rank 752: CohereLabs/xP3x
xP3x (Crosslingual Public Pool of Prompts eXtended) is a collection of prompts & datasets across 277 languages & 16 NLP tasks. It contains all of xP3 + much more! It is…
105 likes50,037 downloads in the last 30 daysOtherApache 2.0