Independent project. Not a U.S. government website.Independent project. Not a United States government website.
Support our projectSupport usSupport our project · Buy me a coffee (opens Buy Me a Coffee)GLM-5.1-Reasoning-1M-Cleaned is a cleaned and reformatted derivative of Kassadin88/GLM-5.1-1000000x. It preserves the original four-subset layout (main, PHD-Science, Mul…
301 likes885 downloads in the last 30 daysText generationApache 2.0
synthetic dataset of reasoning chains for a wide variety of tasks. we leverage data like this across multiple reasoning experiments/projects. stay tuned for reasoning mo…
299 likes264 downloads in the last 30 daysApache 2.0
The WAXAL dataset is a large-scale multilingual speech corpus for African languages, introduced in the paper WAXAL: A Large-Scale Multilingual African Language Speech Co…
298 likes9,625 downloads in the last 30 daysSpeech recognitionCC BY-SA 4.0
TruthfulQA is a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categori…
297 likes135,664 downloads in the last 30 daysMultiple choiceApache 2.0
UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing 📜 Paper | 💻 Code | 🤖 Models | 📦 UltraData Collection English | 中文 📚 Introduction Ultr…
296 likes11,906 downloads in the last 30 daysText generationApache 2.0
malcolmrey's Various AI Model, Architecture & Research Repository Welcome to the central research and asset repository of malcolmrey. This repository hosts cutting-edge…
295 likes31,256 downloads in the last 30 daysWTFPL
Genshin Voice is a dataset of voice lines from the popular game Genshin Impact. Hugging Face 🤗 Genshin-Voice ModelScope Genshin-Voice Per-speaker downloads are grouped…
295 likes19,518 downloads in the last 30 daysAudio classificationNo license given
The People's Speech Dataset is among the world's largest English speech recognition corpus today that is licensed for academic and commercial usage under CC-BY-SA and CC…
294 likes34,319 downloads in the last 30 daysSpeech recognitionCC BY 2.0
ShareGPT-Chinese-English-90k Bilingual Human-Machine QA Dataset A high-quality Chinese-English parallel bilingual human-machine QA dataset, covering user questions in re…
293 likes1,434 downloads in the last 30 daysQuestion answeringApache 2.0
The MNIST dataset consists of 70,000 28x28 black-and-white images of handwritten digits extracted from two NIST databases. There are 60,000 images in the training datase…
291 likes113,206 downloads in the last 30 daysImage classificationMIT
RoboOmni: Proactive Robot Manipulation in Omni-modal Context 📖 arXiv Paper (Accepted to ICLR 2026 🎉) | 🌐 Website | 🤗 Model | 🤗 Dataset | 🛠️ Github | Recent advance…
290 likes171,993 downloads in the last 30 daysRoboticsCC BY-NC 4.0
We curate a large corpus of legal and administrative data. The utility of this data is twofold: (1) to aggregate legal and administrative data sources that demonstrate d…
290 likes11,679 downloads in the last 30 daysFill maskCC BY-NC-SA 4.0
Mobile Actions: A Dataset for On-Device Function Calling The dataset contains conversational traces designed to train lightweight models (such as FunctionGemma 270M) to…
289 likes877 downloads in the last 30 daysCC BY 4.0
This is the dataset proposed in our paper [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation. OpenVid-1M is a high-quality text-to-v…
289 likes100,214 downloads in the last 30 daysText to videoCC BY 4.0
The FineTome dataset is a subset of arcee-ai/The-Tome (without arcee-ai/qwen2-72b-magpie-en), re-filtered using HuggingFaceFW/fineweb-edu-classifier. It was made for my…
287 likes24,350 downloads in the last 30 daysNo license given
PhysicalAI-Robotics-GR00T-X-Embodiment-Sim Github Repo: Isaac GR00T N1 We provide a set of datasets used for post-training of GR00T N1. Each dataset is a collection of t…
287 likes758,310 downloads in the last 30 daysRoboticsCC BY 4.0
The key arguments for the low utilization of statistical techniques in financial sentiment analysis have been the difficulty of implementation for practical applications…
287 likes9,059 downloads in the last 30 daysText classificationCC BY NC SA 3.0
VIBE: Visual & Interactive Benchmark for Execution in Application Development [English] | 中文 🌟 Overview VIBE (Visual & Interactive Benchmark for Execution) sets a new s…
284 likes267 downloads in the last 30 daysText generationMIT
Visit Github : What is TongSIM-Asset? As artificial intelligence (AI) rapidly advances, especially in multimodal large language models, research focus is shifting from s…
280 likes813 downloads in the last 30 daysNo license given
TxT360: A Top-Quality LLM Pre-training Dataset Requires the Perfect Blend Changelog Version Details v1.1 Added new data sources: TxT360_BestOfWeb, TxT360_QA, europarl-al…
280 likes18,522 downloads in the last 30 daysText generationODC-By
Boasting over 13,000 hours of cumulative data and 5 million+ clips, it ranks as the largest open-source embodied intelligence dataset in the industry. Update Notes：Stage…
279 likes263,776 downloads in the last 30 daysRoboticsCC BY-SA 4.0Gated
RubricHub is a large-scale (approximately 110K), multi-domain dataset that provides high-quality rubric-based supervision for open-ended generation tasks. It is construc…
278 likes978 downloads in the last 30 daysText generationApache 2.0
The GoEmotions dataset contains 58k carefully curated Reddit comments labeled for 27 emotion categories or Neutral. The raw data is included as well as the smaller, simp…
276 likes22,559 downloads in the last 30 daysText classificationApache 2.0
We have released a paper for OpenThoughts! See our paper here. OpenThoughts3-1.2M Open-source state-of-the-art reasoning dataset with 1.2M rows. 🚀 OpenThoughts3-1.2M is…
276 likes22,595 downloads in the last 30 daysText generationApache 2.0
Note that this collection is licensed under ODC-BY-1.0 license; different licenses apply to subsets of the data. Some portions of the dataset are non-commercial. We pres…
275 likes30,570 downloads in the last 30 daysOtherODC-By
Refined Anime Text for Continual Pre-training of Language Models This is a subset of our novel synthetic dataset of anime-themed text, containing over 1M entries, ~440M…
274 likes23 downloads in the last 30 daysText generationWTFPLGated
Default Licensing for Sub-Datasets Without Specific License Declaration: In instances where sub-datasets within the COIG-PC Dataset do not have a specific license declar…
272 likes819 downloads in the last 30 daysUnknown licenseGated
Multi-Teacher Distillation Dataset (57,937 traces) A quality-filtered, deduplicated, multi-teacher SFT corpus combining traces from three frontier models across math, co…
272 likes3,508 downloads in the last 30 daysText generationOther license
FRAMES: Factuality, Retrieval, And reasoning MEasurement Set FRAMES is a comprehensive evaluation dataset designed to test the capabilities of Retrieval-Augmented Genera…
271 likes25,122 downloads in the last 30 daysText classificationApache 2.0
Zhihu data for training Open Assitant More Information needed
270 likes1,966 downloads in the last 30 daysQuestion answeringNo license given
1,000,000 reasoning traces distilled from KIMI-K2.5 on high reasoning, (Each subset has different questions) Distribution: Coding: 50% (Includes: Webdev, Python, C++, Ja…
269 likes432 downloads in the last 30 daysText generationApache 2.0
Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the a…
269 likes49,966 downloads in the last 30 daysQuestion answeringCC BY-SA 4.0
Enhancing Human-Like Responses in Large Language Models 🤗 Models | 📊 Dataset | 📄 Paper 📢 The paper associated with this dataset has been accepted to the AAAI-26 Work…
267 likes438 downloads in the last 30 daysLlama 3 license
The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals,…
266 likes236,204 downloads in the last 30 daysCC BY 4.0
This is the Official Capybara dataset. Over 10,000 multi-turn examples. Capybara is the culmination of insights derived from synthesis techniques like Evol-instruct (use…
266 likes1,234 downloads in the last 30 daysQuestion answeringApache 2.0
Gaming Dataset (gaming-1) — 494.7 Hours Native PC/console gameplay screen-recordings, organized by game. Each workflow is one play session, trimmed to pure gameplay — lo…
265 likes9,239 downloads in the last 30 daysNo license given
The 90,000-hour head-view line of EgoSuite-Open100K. Data Bucket · Collection · EgoDemo · EgoPro · Project page Explore EgoSuite-Open100K ↗ Data location: EgoStandard is…
264 likes10,542 downloads in the last 30 daysVideo classificationCommercial training no resale v1.0Gated
OpenMathInstruct-2 is a math instruction tuning dataset with 14M problem-solution pairs generated using the Llama3.1-405B-Instruct model. The training set problems of GS…
263 likes98,372 downloads in the last 30 daysQuestion answeringCC BY 4.0
This is an experimental Dataset designed to run a Medical Chatbot It contains at least 250k dialogues between a Patient and a Doctor. Playground ChatBot ruslanmv/AI-Medi…
262 likes3,075 downloads in the last 30 daysNo license given
HelpSteer is an open-source Helpfulness Dataset (CC-BY-4.0) that supports aligning models to become more helpful, factually correct and coherent, while being adjustable…
259 likes3,738 downloads in the last 30 daysCC BY 4.0
OpenMathInstruct-1 is a math instruction tuning dataset with 1.8M problem-solution pairs generated using permissively licensed Mixtral-8x7B model. The problems are from…
259 likes4,963 downloads in the last 30 daysQuestion answeringNvidia license
A high-quality synthetic dataset of medical reasoning conversations generated using OpenAI's gpt-oss-120B model with reasoning effort set to high, designed for supervise…
259 likes2,758 downloads in the last 30 daysText generationApache 2.0
Starting with a paper released at NIPS 2016, MS MARCO is a collection of datasets focused on deep learning in search. The first dataset was a question answering dataset…
257 likes32,964 downloads in the last 30 daysNo license given
Find the 1500+ scenes in the sample_set/26.04_release folder. Dataset Description: Neural reconstructed dataset that carries 3D reconstructed driving scenes. The scenes…
257 likes49,574 downloads in the last 30 daysNvidia av datasetGated
🔥 🔥 🔥 [08/11/2023] We release WizardMath Models. 🔥 Our WizardMath-70B-V1.0 model slightly outperforms some closed-source LLMs on the GSM8K, including ChatGPT 3.5, Cl…
257 likes1,934 downloads in the last 30 daysMIT
Multilingual Embeddings for Wikipedia in 300+ Languages This dataset contains the wikimedia/wikipedia dataset dump from 2023-11-01 from Wikipedia in all 300+ languages.…
256 likes4,560 downloads in the last 30 daysNo license given
Homepage: Repository: Paper: Point of Contact: Dataset Summary DialogSum is a large-scale dialogue summarization dataset, consisting of 13,460 (Plus 100 holdout data for…
256 likes5,400 downloads in the last 30 daysSummarizationCC BY-NC-SA 4.0
Open Source Implementation of Evol-Instruct-Code as described in the WizardCoder Paper. Code for the intruction generation can be found on Github as Evol-Teacher.
255 likes7,053 downloads in the last 30 daysCC BY-NC-SA 4.0
The Character Codex is a comprehensive dataset featuring popular characters from a wide array of media types and genres. Each entry includes detailed information about t…
255 likes270 downloads in the last 30 daysApache 2.0
OPUS-100 is an English-centric multilingual corpus covering 100 languages. OPUS-100 is English-centric, meaning that all training pairs include English on either the sou…
254 likes25,074 downloads in the last 30 daysTranslationUnknown license
rStar-Coder is a large-scale competitive code problem dataset containing 418K programming problems, 580K long-reasoning solutions, and rich test cases of varying difficu…
254 likes9,080 downloads in the last 30 daysCC BY 4.0
This repository contains ShapeNetCore (v2), a subset of ShapeNet.ShapeNetCore is a densely annotated subset of ShapeNet covering 55 common object categories with ~51,300…
252 likes4,810 downloads in the last 30 daysOther licenseGated
YODAS v3 is a large web-crawled dataset containing over 1.1 million hours of audio that were originally released under a CC-BY-3.0 license. The dataset contains audio in…
251 likes342,623 downloads in the last 30 daysAudio to audioCC BY 3.0
⚠️ Important: If you have already submitted an access request but have not completed the required DocuSign agreement, your request will remain pending. Please complete s…
251 likes51,077 downloads in the last 30 daysVideo classificationOther licenseGated
🌐 Essential-Web: Complete 24-Trillion Token Dataset 🏆 Website | 🖥️ Code | 📖 Paper | ☁️ AWS 📋 Dataset Description Essential-Web is a 24-trillion-token web dataset wi…
250 likes139,268 downloads in the last 30 daysODC-By
LibriSpeech is a corpus of approximately 1000 hours of 16kHz read English speech, prepared by Vassil Panayotov with the assistance of Daniel Povey. The data is derived f…
249 likes70,133 downloads in the last 30 daysSpeech recognitionCC BY 4.0
Yambda-5B — A Large-Scale Multi-modal Dataset for Ranking And Retrieval Industrial-scale music recommendation dataset with organic/recommendation interactions and audio…
249 likes14,265 downloads in the last 30 daysApache 2.0
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement [🏠Homepage] | [🛠️Code] Introduction OpenCodeInterpreter is a family of open-source code…
248 likes1,807 downloads in the last 30 daysQuestion answeringApache 2.0
A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: " This is the processed version of Google's C4 dataset by AllenAI.
247 likes15,252 downloads in the last 30 daysText generationODC-By
WebGPT Comparisons contains all of the comparisons marked as suitable for reward modelling from the WebGPT paper.
247 likes1,064 downloads in the last 30 daysNo license given
This dataset is uploaded in two places: here and additionally here as 'Aya Collection Language Split.' These datasets are identical in content but differ in structure of…
245 likes15,856 downloads in the last 30 daysText classificationApache 2.0
s1K is a dataset of 1,000 examples of diverse, high-quality & difficult questions with distilled reasoning traces & solutions from Gemini Thining. Refer to the s1 paper…
245 likes8,495 downloads in the last 30 daysApache 2.0
Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models Big-Math is the largest open-source dataset of high-quality mathematical…
245 likes5,440 downloads in the last 30 daysQuestion answeringApache 2.0Gated
We are excited to release a synthetic reasoning dataset containing 22mil+ general reasoning questions and responses generated using deepseek-ai/DeepSeek-R1-Distill-Llama…
244 likes2,938 downloads in the last 30 daysText generationApache 2.0
Finance-Instruct-500k is a comprehensive and meticulously curated dataset designed to train advanced language models for financial tasks, reasoning, and multi-turn conve…
244 likes674 downloads in the last 30 daysApache 2.0
MedMCQA is a large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions. MedMCQA has more than 194k hi…
243 likes72,699 downloads in the last 30 daysQuestion answeringApache 2.0
Toucan-1.5M is the largest fully synthetic tool-agent dataset to date, designed to advance tool use in agentic LLMs. It comprises over 1.5 million trajectories synthesiz…
242 likes10,687 downloads in the last 30 daysApache 2.0
A dataset of high quality mathematical text.
242 likes30,341 downloads in the last 30 daysText generationNo license given
[2024-09-01]: Uploaded VisualWebInstruct(filtered), it's used in OneVision Stage almost all subsets are uploaded with HF's required format and you can use the recommende…
242 likes36,372 downloads in the last 30 daysApache 2.0
MiroVerse: A Reproducible, Full-Trajectory, Ever-Growing Deep Research Dataset 🔥 News & Updates MiroVerse v0.1 has been released. This dataset can be used with our trai…
242 likes170 downloads in the last 30 daysQuestion answeringCC BY-NC 4.0Gated
242 likes16,273 downloads in the last 30 daysText generationCC BY 4.0
🤗 [Models] • 💻 [Github Repo] • 📌 [Project Page] • 📃 [Paper] AgentInstruct is a meticulously curated dataset featuring 1,866 high-quality interactions, designed to en…
242 likes2,514 downloads in the last 30 daysNo license given
CodeContests is a competitive programming dataset for machine-learning. This dataset was used when training AlphaCode. It consists of programming problems, from a variet…
241 likes83,680 downloads in the last 30 daysTranslationCC BY 4.0
Dataset containing 81,444 pieces of visual art from various artists, taken from WikiArt.org, along with class labels for each image : "artist" : 129 artist classes, incl…
241 likes8,340 downloads in the last 30 daysImage classificationUnknown license
A fully synthetic healthcare dataset for building AI solutions in healthcare, developed using Syncora.ai. ✅ What's in This Repo? ✅ Healthcare Dataset (CSV) → Download He…
241 likes254 downloads in the last 30 daysApache 2.0
TMMLU+ : Large scale traditional chinese massive multitask language understanding iKala presents TMMLU+, a large-scale benchmark for evaluating LLM capabilities in Tradi…
240 likes7,173 downloads in the last 30 daysQuestion answeringMIT
⚠️Important Notice !!! Dear Users, The Alpha Dataset has been updated as follows: Frame Loss Data Removal: Several episodes with frame loss issues have been removed. For…
239 likes26,732 downloads in the last 30 daysRoboticsNo license givenGated
P3 (Public Pool of Prompts) is a collection of prompted English datasets covering a diverse set of NLP tasks. A prompt is the combination of an input template and a targ…
239 likes135,908 downloads in the last 30 daysOtherApache 2.0
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Supported Tasks and Leaderboards Multi-modal Multiple Choice Languages English D…
239 likes33,277 downloads in the last 30 daysMultiple choiceCC BY-SA 4.0
FineFineWeb: A Comprehensive Study on Fine-Grained Domain Web Corpus arXiv: Coming Soon Project Page: Coming Soon Blog: Coming Soon Data Statistics Domain (#tokens/#samp…
239 likes4,004,565 downloads in the last 30 daysText classificationApache 2.0
The OpenHermes dataset is composed of 242,000 entries of primarily GPT-4 generated data, from open datasets across the AI landscape, including: OpenHermes 13B is the fir…
239 likes1,309 downloads in the last 30 daysText generationNo license given
This dataset is designed to train a reasoning model. That can think through complex problems before providing a response, similar to how a human would. The dataset inclu…
238 likes497 downloads in the last 30 daysText generationApache 2.0
Human ChatGPT Comparison Corpus (HC3)
237 likes5,043 downloads in the last 30 daysText classificationCC BY-SA 4.0
The AI CUDA Engineer Archive 👷: Agentic CUDA Kernel Discovery, Optimization & Composition We release The AI CUDA Engineer archive, a dataset consisting of approximately…
234 likes9,833 downloads in the last 30 daysCC BY 4.0
Open-MM-RL is a multimodal STEM reasoning dataset covering Physics, Mathematics, Biology, and Chemistry. It is designed for problems that require models to interpret vis…
233 likes179 downloads in the last 30 daysQuestion answeringMIT
MathVista is a consolidated Mathematical reasoning benchmark within Visual contexts. It consists of three newly created datasets, IQTest, FunctionQA, and PaperQA, which…
232 likes24,259 downloads in the last 30 daysMultiple choiceCC BY-SA 4.0
LLaVA Visual Instruct Pretrain Dataset Card Dataset details Dataset type: LLaVA Visual Instruct Pretrain LCS-558K is a subset of LAION/CC/SBU dataset, filtered with a mo…
232 likes6,522 downloads in the last 30 daysOther license
This dataset contains images used in the documentation of HuggingFace's libraries. HF Team: Please make sure you optimize the assets before uploading them. My favorite t…
231 likes4,957,025 downloads in the last 30 daysCC BY-NC-SA 4.0
CodeForces-CoTs is a large-scale dataset for training reasoning models on competitive programming tasks. It consists of 10k CodeForces problems with up to five reasoning…
231 likes5,184 downloads in the last 30 daysCC BY 4.0
中文基于满血DeepSeek-R1蒸馏数据集（Chinese-Data-Distill-From-R1） 🤗 Hugging Face | 🤖 ModelScope | 🚀 Github | &n…
230 likes980 downloads in the last 30 daysText generationApache 2.0
Granary: Speech Recognition and Translation Dataset in 25 European Languages Granary is a large-scale, open-source multilingual speech dataset covering 25 European langu…
230 likes5,874 downloads in the last 30 daysSpeech recognitionCC BY 4.0
Summarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.
230 likes3,828 downloads in the last 30 daysNo license given
Objaverse-XL is an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities:…
229 likes3,191 downloads in the last 30 daysODC-By
229 likes4,142 downloads in the last 30 daysNo license givenGated
OpenAI MRCR: Long context multiple needle in a haystack benchmark OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's a…
229 likes9,512 downloads in the last 30 daysMIT
DialogStudio: Unified Dialog Datasets and Instruction-Aware Models for Conversational AI Author: Jianguo Zhang, Kun Qian Paper|Github|[GDrive] 🎉 March 18, 2024: Update…
229 likes148 downloads in the last 30 daysQuestion answeringApache 2.0Gated
The NitroGen dataset contains action annotations for publicly available gameplay videos. Specifically, we used an in-house model to annotate each video frame with gamepa…
228 likes1,796 downloads in the last 30 daysRoboticsCC BY-NC 4.0
Claude protein binder design — data release v1.0 1,440 de novo miniprotein binders (50 to 120 residues) against 16 targets, designed by two Claude models operating as au…
227 likes38,433 downloads in the last 30 daysCC BY 4.0
This dataset has been created with distilabel. 📰 News [26/11/2024] 🆕 New version of the dataset is out! magpie-ultra-v1.0 is a new version of the MagPie Ultra dataset…
227 likes1,903 downloads in the last 30 daysText generationLlama 3.1 license
Agents Last Exam v1.1 — Task Card Metadata 150 active tasks. Use matching v1.1 task code, environment images, and data revisions. task_cards.parquet contains one row per…
226 likes5,254 downloads in the last 30 daysCC BY 4.0
Help keep USASI useful.
Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).
About supporting this project