smoltalk
by HuggingFaceTB (organization)
This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More details in our paper During the development of SmolLM2, we observed that models finetuned on public SFT datasets… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceTB/smoltalk
- Likes
- 456
- Downloads (last 30 days)
- 46,924
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 1M to 10M examples
- License
- No license given
- Access
- Open download
- Author
- HuggingFaceTB · Organization
- Languages
- en
- Created
- Nov 17, 2024
- Last modified
- Feb 10, 2025
More datasets from HuggingFaceTB
Rank 43: HuggingFaceTB/cosmopedia
Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia…
767 likes23,941 downloads in the last 30 daysApache 2.0
Rank 86: HuggingFaceTB/smollm-corpus
This dataset is a curated collection of high-quality educational and synthetic data designed for training small language models. You can find more details about the mode…
507 likes54,693 downloads in the last 30 daysODC-By
Rank 139: HuggingFaceTB/finemath
What is it? 📐 FineMath consists of 34B tokens (FineMath-3+) and 54B tokens (FineMath-3+ with InfiMM-WebMath-3+) of mathematical educational content filtered from Common…
391 likes45,575 downloads in the last 30 daysODC-By
Rank 412: HuggingFaceTB/smoltalk2
This dataset contains three subsets (Mid, SFT, Preference) that correspond to the three phases of Post-Training for SmolLM3-3B. You can find more details in our blog pos…
180 likes38,139 downloads in the last 30 daysNo license given
Rank 538: HuggingFaceTB/everyday-conversations-llama3.1-2k
Everyday conversations for Smol LLMs finetunings This dataset contains 2.2k multi-turn conversations generated by Llama-3.1-70B-Instruct. We ask the LLM to generate a si…
141 likes1,668 downloads in the last 30 daysApache 2.0
Rank 581: HuggingFaceTB/smol-smoltalk
This is a subset of SmolTalk dataset adapted for smol models with less than 1B parameters. We used it to build SmolLM2-360M-Instruct and SmolLM2-135M-Instruct. We do SFT…
131 likes12,843 downloads in the last 30 daysApache 2.0