
dclm-baseline-1.0
by mlfoundations (organization)
DCLM-baseline is a 4T token / 3B document pretraining dataset that achieves strong performance on language model benchmarks. Below are comparisions of model trained on DCLM-baseline with other models in the 7B regime. Model Params Tokens Open dataset? CORE MMLU EXTENDED Open… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- mlfoundations/dclm-baseline-1.0
- Likes
- 328
- Downloads (last 30 days)
- 440,863
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 1B to 10B examples
- License
- CC BY 4.0 (cc-by-4.0)
- Access
- Open download
- Author
- mlfoundations · Organization
- Languages
- Not given
- Created
- Jun 17, 2024
- Last modified
- Jul 22, 2024
More datasets from mlfoundations
Rank 582: mlfoundations/MINT-1T-HTML
🍃 MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens 🍃 MINT-1T is an open-source Multimodal INTerleaved dataset with 1 t…
131 likes848,113 downloads in the last 30 daysImage to textCC BY 4.0