smollm-corpus
by HuggingFaceTB (organization)
This dataset is a curated collection of high-quality educational and synthetic data designed for training small language models. You can find more details about the models trained on this dataset in our SmolLM blog post. Dataset subsets Cosmopedia v2 Cosmopedia v2 is an… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceTB/smollm-corpus
- Likes
- 507
- Downloads (last 30 days)
- 54,693
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 100M to 1B examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- HuggingFaceTB · Organization
- Languages
- en
- Created
- Jul 15, 2024
- Last modified
- Sep 6, 2024
More datasets from HuggingFaceTB
Rank 43: HuggingFaceTB/cosmopedia
Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia…
767 likes23,941 downloads in the last 30 daysApache 2.0
Rank 109: HuggingFaceTB/smoltalk
This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More detail…
456 likes46,924 downloads in the last 30 daysNo license given
Rank 139: HuggingFaceTB/finemath
What is it? 📐 FineMath consists of 34B tokens (FineMath-3+) and 54B tokens (FineMath-3+ with InfiMM-WebMath-3+) of mathematical educational content filtered from Common…
391 likes45,575 downloads in the last 30 daysODC-By
Rank 412: HuggingFaceTB/smoltalk2
This dataset contains three subsets (Mid, SFT, Preference) that correspond to the three phases of Post-Training for SmolLM3-3B. You can find more details in our blog pos…
180 likes38,139 downloads in the last 30 daysNo license given
Rank 538: HuggingFaceTB/everyday-conversations-llama3.1-2k
Everyday conversations for Smol LLMs finetunings This dataset contains 2.2k multi-turn conversations generated by Llama-3.1-70B-Instruct. We ask the LLM to generate a si…
141 likes1,668 downloads in the last 30 daysApache 2.0
Rank 581: HuggingFaceTB/smol-smoltalk
This is a subset of SmolTalk dataset adapted for smol models with less than 1B parameters. We used it to build SmolLM2-360M-Instruct and SmolLM2-135M-Instruct. We do SFT…
131 likes12,843 downloads in the last 30 daysApache 2.0