smol-smoltalk
by HuggingFaceTB (organization)
This is a subset of SmolTalk dataset adapted for smol models with less than 1B parameters. We used it to build SmolLM2-360M-Instruct and SmolLM2-135M-Instruct. We do SFT on this dataset and then DPO on UltraFeedback. Compared to SmolTalk: The conversations from… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceTB/smol-smoltalk
- Likes
- 131
- Downloads (last 30 days)
- 12,843
- Tasks
- Not given
- Modality
- text
- Size
- 100K to 1M examples
- License
- Apache 2.0 (apache-2.0)
- Access
- Open download
- Author
- HuggingFaceTB · Organization
- Languages
- en
- Created
- Nov 21, 2024
- Last modified
- Feb 6, 2025
More datasets from HuggingFaceTB
Rank 43: HuggingFaceTB/cosmopedia
Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia…
767 likes23,941 downloads in the last 30 daysApache 2.0
Rank 86: HuggingFaceTB/smollm-corpus
This dataset is a curated collection of high-quality educational and synthetic data designed for training small language models. You can find more details about the mode…
507 likes54,693 downloads in the last 30 daysODC-By
Rank 109: HuggingFaceTB/smoltalk
This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More detail…
456 likes46,924 downloads in the last 30 daysNo license given
Rank 139: HuggingFaceTB/finemath
What is it? 📐 FineMath consists of 34B tokens (FineMath-3+) and 54B tokens (FineMath-3+ with InfiMM-WebMath-3+) of mathematical educational content filtered from Common…
391 likes45,575 downloads in the last 30 daysODC-By
Rank 412: HuggingFaceTB/smoltalk2
This dataset contains three subsets (Mid, SFT, Preference) that correspond to the three phases of Post-Training for SmolLM3-3B. You can find more details in our blog pos…
180 likes38,139 downloads in the last 30 daysNo license given
Rank 538: HuggingFaceTB/everyday-conversations-llama3.1-2k
Everyday conversations for Smol LLMs finetunings This dataset contains 2.2k multi-turn conversations generated by Llama-3.1-70B-Instruct. We ask the LLM to generate a si…
141 likes1,668 downloads in the last 30 daysApache 2.0