Independent project. Not a U.S. government website.Independent project. Not a United States government website.
Support our projectSupport usSupport our project · Buy me a coffee (opens Buy Me a Coffee)836 of 836 datasets shown
This is a Dataset Repository mirror of prompts.chat — a social platform for AI prompts. 📢 Notice This Hugging Face dataset is a mirror. For the latest prompts, features…
9,893 likes27,767 downloads in the last 30 daysQuestion answeringCC0 1.0
15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tokens (originally 15T tokens) of cleaned an…
3,677 likes328,660 downloads in the last 30 daysText generationODC-By
This repository provides access to two different kinds of data: Human preference data about helpfulness and harmlessness from Training a Helpful and Harmless Assistant w…
2,448 likes33,852 downloads in the last 30 daysMIT
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of que…
2,005 likes1,003,669 downloads in the last 30 daysText generationMIT
Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps ( with one subset per language, each containing a single tr…
1,692 likes294,642 downloads in the last 30 daysText generationCC BY-SA 3.0
We are thrilled to announce the release of the OpenOrca dataset! This rich collection of augmented FLAN data aligns, as best as possible, with the distributions outlined…
1,619 likes12,601 downloads in the last 30 daysText classificationMIT
OpenAssistant Conversations Dataset (OASST1) Dataset Summary In an effort to democratize research on large-scale alignment, we release OpenAssistant Conversations (OASST…
1,609 likes49,470 downloads in the last 30 daysApache 2.0
Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-003 engine. This instruction data can be used to conduct instruction-tun…
1,387 likes82,940 downloads in the last 30 daysText generationCC BY-NC 4.0
databricks-dolly-15k is an open source dataset of instruction-following records generated by thousands of Databricks employees in several of the behavioral categories ou…
1,359 likes39,206 downloads in the last 30 daysQuestion answeringCC BY-SA 3.0
1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: What is it? 📚 FineWeb-Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb-Edu…
1,356 likes422,658 downloads in the last 30 daysText generationODC-By
Large Movie Review Dataset. This is a dataset for binary sentiment classification containing substantially more data than previous benchmark datasets. We provide a set o…
1,297 likes181,993 downloads in the last 30 daysText classificationOther license
Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the a…
1,246 likes202,561 downloads in the last 30 daysQuestion answeringCC BY-SA 4.0
This is a Negative Embedding trained with Counterfeit. Please use it in the "\stable-diffusion-webui\embeddings" folder.It can be used with other models, but the effecti…
1,240 likes37,706 downloads in the last 30 daysOther license
Dataset containing synthetically generated (by GPT-3.5 and GPT-4) short stories that only use a small vocabulary. Described in the following paper: The models referred t…
1,213 likes137,856 downloads in the last 30 daysText generationCDLA SHARING 1.0
RedPajama is a clean-room, fully open-source implementation of the LLaMa dataset.
1,211 likes2,216 downloads in the last 30 daysText generationNo license given
[2025/04/22] We split the data and kept only the medical SFT dataset (medical_o1_sft.json). The file medical_o1_sft_mix.json contains a mix of medical and general instru…
1,202 likes21,341 downloads in the last 30 daysQuestion answeringApache 2.0
This is a heavily filtered version of the UltraChat dataset and was used to train Zephyr-7B-β, a state of the art 7b chat model. The original datasets consists of 1.4M d…
1,181 likes90,067 downloads in the last 30 daysText generationMIT
GLUE, the General Language Understanding Evaluation benchmark ( is a collection of resources for training, evaluating, and analyzing natural language understanding syste…
1,148 likes668,496 downloads in the last 30 daysText classificationOther license
The PhysicalAI-Autonomous-Vehicles dataset provides one of the largest, geographically diverse collections of multi-sensor data empowering AV researchers to build the ne…
1,145 likes244,104 downloads in the last 30 daysNvidia av datasetGated
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
1,107 likes2,859 downloads in the last 30 daysText generationODC-By
Initial release of the Stack. Included 30 programming languages and 18 permissive licenses. Note: Three included licenses (MPL/EPL/LGPL) are considered weak copyleft lic…
1,088 likes7,687 downloads in the last 30 daysText generationOther licenseGated
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset This dataset contains one million real-world conversations with 25 state-of-the-art LLMs. It is collecte…
1,063 likes4,919 downloads in the last 30 daysNo license givenGated
ILSVRC 2012, commonly known as 'ImageNet' is an image dataset organized according to the WordNet hierarchy. Each meaningful concept in WordNet, possibly described by mul…
1,034 likes91,412 downloads in the last 30 daysImage classificationOther licenseGated
IMPORTANT: Please help us protect the integrity of this benchmark by not publicly sharing, re-uploading, or distributing the dataset. Humanity's Last Exam 🌐 Website | �…
1,023 likes28,735 downloads in the last 30 daysMITGated
The idea behind this embedding was to somehow train the negative prompt as an embedding, thus unifying the basis of the negative prompt into one word or embedding. Side…
987 likes3,109 downloads in the last 30 daysCreativeML OpenRAIL-M
Falcon RefinedWeb is a massive English web dataset built by TII and released under an ODC-By 1.0 license. See the 📓 paper on arXiv for more details. RefinedWeb is built…
978 likes36,348 downloads in the last 30 daysText generationODC-By
RL training environments for LLM agents. Domain Task Family Verifier Code Software engineering Executable tests Cyber Vulnerability reproduction Rule checks General Know…
973 likes172,249 downloads in the last 30 daysApache 2.0
We have released a paper for OpenThoughts! See our paper here. Open-Thoughts-114k Open synthetic reasoning dataset with 114k high-quality examples covering math, science…
957 likes87,695 downloads in the last 30 daysApache 2.0
Liberating 3T of the finest tokens from PDFs What is this? As we run out of web pages to process, the natural question has always been: what to do next? Only a few knew…
955 likes74,072 downloads in the last 30 daysText generationODC-By
Further cleaning done. Please look through the dataset and ensure that I didn't miss anything. Update: Confirmed working method for training the model: Two choices: Remo…
951 likes432,301 downloads in the last 30 daysApache 2.0
This is the dataset that made OpenHermes 2.5 and Nous Hermes 2 series of models. Support me on GitHub sponsors 3 : Dataset Details Dataset Description The Open Hermes 2/…
921 likes15,421 downloads in the last 30 daysNo license given
A sparkling update with 1000s of languages What is it? This is the second iteration of the popular 🍷 FineWeb dataset, bringing high quality pretraining data to over 100…
908 likes125,681 downloads in the last 30 daysText generationODC-By
Repository: Dataset Description This is a cleaned version of the original Alpaca Dataset released by Stanford. The following issues have been identified in the original…
898 likes21,062 downloads in the last 30 daysText generationCC BY 4.0
GAIA is a benchmark which aims at evaluating next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc). We…
896 likes11,532 downloads in the last 30 daysNo license givenGated
Measuring Massive Multitask Language Understanding by Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt (ICLR 2021).…
888 likes532,929 downloads in the last 30 daysQuestion answeringMIT
The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset…
865 likes2,017,502 downloads in the last 30 daysText generationCC BY-SA 3.0
Scaling Synthetic Data Creation with 1,000,000,000 Personas This repo releases data introduced in our paper Scaling Synthetic Data Creation with 1,000,000,000 Personas:…
823 likes5,931 downloads in the last 30 daysText generationCC BY-NC-SA 4.0
OpenR1-Math-220k is a large-scale dataset for mathematical reasoning. It consists of 220k math problems with two to four reasoning traces generated by DeepSeek R1 for pr…
813 likes121,838 downloads in the last 30 daysApache 2.0
Instruction-Finetuning Dataset Collection (Alpaca-CoT) This repository will continuously collect various instruction tuning datasets. And we standardize different datase…
804 likes6,238 downloads in the last 30 daysApache 2.0
中文基于满血DeepSeek-R1蒸馏数据集（Chinese-Data-Distill-From-R1） 🤗 Hugging Face | 🤖 ModelScope | 🚀 Github | &n…
798 likes1,529 downloads in the last 30 daysText generationApache 2.0
COIG-CQIA：Quality is All you need for Chinese Instruction Fine-tuning Dataset Details Dataset Description 欢迎来到COIG-CQIA，COIG-CQIA全称为Chinese Open Instruction Generalist -…
788 likes7,846 downloads in the last 30 daysQuestion answeringNo license given
Beijing Academy of Artificial Intelligence (BAAI) [Paper][Code][🤗] The quality and scale of instruction data are crucial for model performance. Recently, open-source mo…
768 likes1,959 downloads in the last 30 daysText generationCC BY-SA 4.0Gated
Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia…
767 likes23,941 downloads in the last 30 daysApache 2.0
FlyRank Internship — Pseudonymized Warehouse Release (v20260703) The open-ended, warehouse-shaped dataset (~81.8M rows; daily fact 78,835,655 rows) for advanced capstone…
744 likes4,677 downloads in the last 30 daysOther licenseGated
This repo contains 60,000 data collected by APIGen, an automated data generation pipeline designed to produce verifiable high-quality datasets for function-calling appli…
741 likes20,061 downloads in the last 30 daysQuestion answeringCC BY 4.0Gated
Airline Customer Support English Audio Dataset Text spoken by all participants: I missed my connecting flight due to a delay; can you book me on the next available fligh…
728 likes69 downloads in the last 30 daysAudio classificationCC BY 4.0
Medical Prescription English Audio Dataset Text spoken by all participants: "Doctor, my third visit, and I'm hopeful but not fully better. Joint pain eased slightly, yet…
727 likes98 downloads in the last 30 daysAudio classificationCC BY 4.0
Llama-Nemotron-Post-Training-Dataset-v1.1 Release Update [4/8/2025]: v1.1: We are releasing an additional 2.2M Math and 500K Code Reasoning Data in support of our releas…
716 likes6,085 downloads in the last 30 daysCC BY 4.0
Image generated by DALL-E. See prompt for more details synthetic_text_to_sql gretelai/synthetic_text_to_sql is a rich dataset of high quality synthetic Text-to-SQL sampl…
708 likes3,668 downloads in the last 30 daysQuestion answeringApache 2.0
Cleaned, Enormous, and Public: The Multilingual Fuel to Democratize Large Language Models for 167 Languages Dataset Summary We present CulturaX, a substantial multilingu…
701 likes25,707 downloads in the last 30 daysText generationNo license givenGated
A snapshot of arXiv's metadata, version history, submission files and rendered documents. It covers 3,148,796 papers and includes file contents, paths, sizes and SHA-256…
697 likes235,187 downloads in the last 30 daysText generationMixed arxiv author licenses
A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: " This is the processed version of Google's C4 dataset We prepared five va…
688 likes773,370 downloads in the last 30 daysText generationODC-By
Wikipedia dataset containing cleaned articles of all languages. The datasets are built from the Wikipedia dump ( with one split per language. Each example contains the c…
684 likes59,430 downloads in the last 30 daysText generationCC BY-SA 3.0
DiffusionDB is the first large-scale text-to-image prompt dataset. It contains 2 million images generated by Stable Diffusion using prompts and hyperparameters specified…
674 likes28,377 downloads in the last 30 daysText to imageCC0 1.0
Banking Customer Support English Audio Dataset Text spoken by all participants: "I forgot my online banking password; how do I reset it? I’m locked out of my account and…
664 likes72 downloads in the last 30 daysAudio classificationCC BY 4.0
MNBVC: Massive Never-ending BT Vast Chinese corpus
660 likes216,232 downloads in the last 30 daysText generationMIT
[!WARNING] NOTICE: The original dataset has been updated with better filtering. Please use the original dataset, not this one. Filtered from: The original dataset has 97…
660 likes420 downloads in the last 30 daysApache 2.0
Banking Customer Support Hinglish Audio Dataset Text spoken by all participants: "Mera online banking password bhool gaya, kaise reset karoon? Mera account lock ho gaya…
658 likes62 downloads in the last 30 daysAudio classificationCC BY 4.0
The dataset consists of 4 versions: bigcode/the-stack-v2: the full "The Stack v2" dataset -- you are here bigcode/the-stack-v2-dedup: based on the bigcode/the-stack-v2 b…
653 likes6,787 downloads in the last 30 daysText generationOther licenseGated
LLaVA Visual Instruct 150K Dataset Card Dataset details Dataset type: LLaVA Visual Instruct 150K is a set of GPT-generated multimodal instruction-following data. It is c…
644 likes4,659 downloads in the last 30 daysVisual question answeringCC BY 4.0
Approximately 860k math problems, where each solution is formatted in a Chain of Thought (CoT) manner. The sources of the dataset range from Chinese high school math exe…
612 likes259,372 downloads in the last 30 daysText generationApache 2.0
Look Ma, an instruction dataset that wasn't generated by GPTs! Dataset Summary No Robots is a high-quality dataset of 10,000 instructions and demonstrations created by s…
600 likes53,100 downloads in the last 30 daysText generationCC BY-NC 4.0
NaturalReasoning is a large-scale dataset for general reasoning tasks. It consists of high-quality challenging reasoning questions backtranslated from pretraining corpor…
591 likes4,330 downloads in the last 30 daysText generationCC BY-NC 4.0
The Anthropic Economic Index provides insights into how AI is being incorporated into real-world tasks across the modern economy. Data Releases This repository contains…
590 likes18,337 downloads in the last 30 daysMIT
GPQA is a multiple-choice, Q&A dataset of very hard questions written and validated by experts in biology, physics, and chemistry. When attempting questions out of their…
588 likes103,629 downloads in the last 30 daysQuestion answeringCC BY 4.0Gated
MMLU-Pro dataset is a more robust and challenging massive multi-task understanding dataset tailored to more rigorously benchmark large language models' capabilities. Thi…
577 likes239,436 downloads in the last 30 daysQuestion answeringMIT
우리나라 실제 분포에 기반한 합성 페르소나를 위한 복합 AI 시스템 A compound AI approach to personas grounded in real-world distributions 데이터셋 개요 (Overview) Nemotron-Personas-Korea는 대한민국의 실제 인구통계학적…
573 likes5,115 downloads in the last 30 daysText generationCC BY 4.0
OpenCodeReasoning: Advancing Data Distillation for Competitive Coding Data Overview OpenCodeReasoning is the largest reasoning-based synthetic dataset to date for coding…
572 likes11,893 downloads in the last 30 daysText generationCC BY 4.0
The Cauldron is part of the Idefics2 release. It is a massive collection of 50 vision-language datasets (training sets only) that were used for the fine-tuning of the vi…
565 likes330,260 downloads in the last 30 daysNo license given
CAD-1K Open v2 - 1,018.1229 Hours 509 end-to-end, single-display Windows CAD task recordings across seven CAD software families. Each task contains: task_desc.json - tas…
562 likes130,103 downloads in the last 30 daysNo license given
Dataset for GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks. Paper | Blog | Site 220 real-world knowledge tasks across 44 occupations.…
562 likes308,395 downloads in the last 30 daysNo license given
This is the dataset used for training StarCoder and StarCoderBase. It contains 783GB of code in 86 programming languages, and includes 54GB GitHub Issues + 13GB Jupyter…
557 likes15,801 downloads in the last 30 daysText generationOther licenseGated
An open-source replication of the WebText dataset from OpenAI, that was used to train GPT-2. This distribution was created by Aaron Gokaslan and Vanya Cohen of Brown Uni…
543 likes43,391 downloads in the last 30 daysText generationCC0 1.0
This is a set of about 80,000 prompts filtered and extracted from the image finder for Stable Diffusion: "Lexica.art". It was a little difficult to extract the data, sin…
541 likes4,749 downloads in the last 30 daysUnknown license
537 likes34,256 downloads in the last 30 daysText generationApache 2.0
*This dataset contains intentionally low-quality (“B-grade”) data. It has been curated to include noisy, imperfect, or otherwise suboptimal samples for the purpose of te…
537 likes72 downloads in the last 30 daysAudio classificationCC BY 4.0
Multilingual Massive Multitask Language Understanding (MMMLU) The MMLU is a widely recognized benchmark of general knowledge attained by AI models. It covers a broad ran…
534 likes13,640 downloads in the last 30 daysQuestion answeringMIT
FineVision is a massive collection of datasets with 17.3M images, 24.3M samples, 88.9M turns, and 9.5B answer tokens, designed for training state-of-the-art open Vision-…
533 likes145,663 downloads in the last 30 daysNo license given
Sorry, it's no longer available on Hugging Face. Please reach out to those who have already downloaded it. If you have a copy, please refrain from re-uploading it to Hug…
517 likes71 downloads in the last 30 daysText generationGPL 3.0Gated
An open-source, large-scale, and multi-round dialogue data powered by Turbo APIs. In consideration of factors such as safeguarding privacy, we do not directly use any da…
516 likes6,339 downloads in the last 30 daysText generationMIT
This dataset builds from WikiSQL and Spider. There are 78,577 examples of natural language queries, SQL CREATE TABLE statements, and SQL Query answering the question usi…
514 likes4,563 downloads in the last 30 daysText generationCC BY 4.0
Amod/mental_health_counseling_conversations This dataset is a compilation of high-quality, real one-on-one mental health counseling conversations between individuals and…
513 likes1,285 downloads in the last 30 daysText generationRail dGated
The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.
512 likes8,740 downloads in the last 30 daysText generationOther license
Synthetic AI Developer Productivity Dataset — Behavioral + Cognitive Simulation A synthetic data generation resource for modeling behavioral and cognitive dynamics in de…
512 likes100 downloads in the last 30 daysApache 2.0
This dataset contains ~200K grade school math word problems. All the answers in this dataset is generated using Azure GPT4-Turbo. Please refer to Orca-Math: Unlocking th…
509 likes31,991 downloads in the last 30 daysQuestion answeringMIT
This dataset is a curated collection of high-quality educational and synthetic data designed for training small language models. You can find more details about the mode…
507 likes54,693 downloads in the last 30 daysODC-By
This dataset is the compilation of structured output and function calling data used in the Hermes 2 Pro series of models. This repository contains a structured output da…
502 likes57,265 downloads in the last 30 daysText generationApache 2.0
E-Commerce Customer Support Hinglish Audio Dataset Text spoken by all participants: "Mera order abhi tak nahi aaya, uska tracking kar sakte hain? Kal tak aana tha, mujhe…
499 likes56 downloads in the last 30 daysAudio classificationCC BY 4.0
This dataset contains 33K cleaned conversations with pairwise human preferences. It is collected from 13K unique IP addresses on the Chatbot Arena from April to June 202…
499 likes1,807 downloads in the last 30 daysCCGated
Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generation This is the official repository 👑 for the Emilia dataset and the source…
497 likes32,645 downloads in the last 30 daysText to speechCC BY 4.0Gated
This dataset contains screen recordings of users navigating the Expedia platform (www.expedia.com) to simulate booking a flight from any origin to any destination. Each…
496 likes50 downloads in the last 30 daysVideo classificationCC BY 4.0
Fleurs is the speech version of the FLoRes machine translation benchmark. We use 2009 n-way parallel sentences from the FLoRes dev and devtest publicly available sets, i…
488 likes147,521 downloads in the last 30 daysSpeech recognitionCC BY 4.0
see our paper at Note All MetaMathQA data are augmented from the training sets of GSM8K and MATH. None of the augmented data is from the testing set. You can check the o…
485 likes66,163 downloads in the last 30 daysMIT
OpenMathReasoning is a large-scale math reasoning dataset for training large language models (LLMs). This dataset contains 306K unique mathematical problems sourced from…
485 likes70,269 downloads in the last 30 daysQuestion answeringCC BY 4.0
This dataset contains a collection of car images designed to support tasks such as image classification, car detection, and autonomous driving research. The images featu…
481 likes391 downloads in the last 30 daysImage classificationCC BY 4.0
A high-quality dataset for efficient instruction tuning.
478 likes888 downloads in the last 30 daysOther licenseGated
Objaverse is a Massive Dataset with 800K+ Annotated 3D Objects. More documentation is coming soon. In the meantime, please see our paper and website for additional detai…
477 likes477,055 downloads in the last 30 daysODC-By
Emotion is a dataset of English Twitter messages with six basic emotions: anger, fear, joy, love, sadness, and surprise. For more detailed information please refer to th…
476 likes39,459 downloads in the last 30 daysText classificationOther license
This dataset contains a collection of physics problems designed for educational and research purposes. Each problem includes a question, relevant equations, and, where a…
475 likes294 downloads in the last 30 daysText generationCC BY 4.0
This dataset is a fully synthetic set of instruction pairs where both the prompts and the responses have been synthetically generated, using the AgentInstruct framework.…
475 likes1,851 downloads in the last 30 daysQuestion answeringCDLA PERMISSIVE 2.0
The list is the Hub’s own ranking by likes: the 1,000 most-liked datasets, down to 100 likes, plus every dataset a USASI catalog record links to. Private and disabled repositories, items tagged not for all audiences, deepfake and undressing tools, “uncensored” or “abliterated” fine-tunes that remove safety training, and jailbreak or leaked-prompt collections are left out. Quantized re-uploads of another model stay and say so. The list includes datasets from anywhere in the world; it shows whether the author is an organization or a personal account and does not guess anyone’s country. A listing is not an endorsement or a USASI catalog review; where a dataset is also in Open Models & Tools or AI on GitHub, its page links there.
Help keep USASI useful.
Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).
About supporting this project