fineweb
by HuggingFaceFW (organization)
15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tokens (originally 15T tokens) of cleaned and deduplicated english web data from CommonCrawl. The data processing pipeline is optimized for LLM… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceFW/fineweb
- Likes
- 3,677
- Downloads (last 30 days)
- 328,660
- Tasks
- Text generation
- Modality
- tabular, text
- Size
- 10B to 100B examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- HuggingFaceFW · Organization
- Languages
- en
- Created
- Apr 18, 2024
- Last modified
- Jul 11, 2025
More datasets from HuggingFaceFW
Rank 10: HuggingFaceFW/fineweb-edu
1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: What is it? 📚 FineWeb-Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb-Edu…
1,356 likes422,658 downloads in the last 30 daysText generationODC-By
Rank 29: HuggingFaceFW/finepdfs
Liberating 3T of the finest tokens from PDFs What is this? As we run out of web pages to process, the natural question has always been: what to do next? Only a few knew…
955 likes74,072 downloads in the last 30 daysText generationODC-By
Rank 32: HuggingFaceFW/fineweb-2
A sparkling update with 1000s of languages What is it? This is the second iteration of the popular 🍷 FineWeb dataset, bringing high quality pretraining data to over 100…
908 likes125,681 downloads in the last 30 daysText generationODC-By
Rank 170: HuggingFaceFW/finewiki
This is an updated and better extracted version of the wikimedia/Wikipedia dataset originally released in 2023. We carefully parsed Wikipedia HTML dumps from August of 2…
336 likes12,000 downloads in the last 30 daysText generationCC BY-SA 4.0
Rank 196: HuggingFaceFW/finetranslations
The world's knowledge in 1+1T tokens of parallel text What is it? This dataset contains over 1 trillion tokens of parallel text in English and 500+ languages. It was obt…
305 likes25,699 downloads in the last 30 daysText generationODC-By
Rank 490: HuggingFaceFW/finephrase
Model: HuggingFaceTB/SmolLM2-1.7B-Instruct (main) Source dataset: HuggingFaceFW/fineweb-edu, config sample-350BT, split train Generation config: temperature=1.0, top_p=1…
157 likes112,152 downloads in the last 30 daysText generationODC-By