
DatasetRank #126 of 836 415 likes
SkyPile-150B
by Skywork (organization)
SkyPile-150B is a comprehensive, large-scale Chinese dataset specifically designed for the pre-training of large language models. It is derived from a broad array of publicly accessible Chinese Internet web pages. Rigorous filtering, extensive deduplication, and thorough… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- Skywork/SkyPile-150B
- Likes
- 415
- Downloads (last 30 days)
- 14,915
- Tasks
- Text generation
- Modality
- text
- Size
- 1M to 10M examples
- License
- No license given
- Access
- Open download
- Author
- Skywork · Organization
- Languages
- zh
- Created
- Oct 23, 2023
- Last modified
- Dec 7, 2023