the-stack-v2-dedup
by bigcode (organization)
The dataset consists of 4 versions: bigcode/the-stack-v2: the full "The Stack v2" dataset bigcode/the-stack-v2-dedup: based on the bigcode/the-stack-v2 but further near-deduplicated -- you are here bigcode/the-stack-v2-train-full-ids: based on the bigcode/the-stack-v2-dedup… (excerpt from the dataset card on Hugging Face)
Access requires accepting terms on Hugging Face.
Dataset facts
- Hub id
- bigcode/the-stack-v2-dedup
- Likes
- 143
- Downloads (last 30 days)
- 2,531
- Tasks
- Text generation
- Modality
- tabular, text
- Size
- 1B to 10B examples
- License
- Other license
- Access
- Gated: access is granted on accepting the terms
- Author
- bigcode · Organization
- Languages
- Not given
- Created
- Feb 26, 2024
- Last modified
- Aug 3, 2026
More datasets from bigcode
Rank 21: bigcode/the-stack
Initial release of the Stack. Included 30 programming languages and 18 permissive licenses. Note: Three included licenses (MPL/EPL/LGPL) are considered weak copyleft lic…
1,088 likes7,687 downloads in the last 30 daysText generationOther licenseGated
Rank 59: bigcode/the-stack-v2
The dataset consists of 4 versions: bigcode/the-stack-v2: the full "The Stack v2" dataset -- you are here bigcode/the-stack-v2-dedup: based on the bigcode/the-stack-v2 b…
653 likes6,787 downloads in the last 30 daysText generationOther licenseGated
Rank 72: bigcode/starcoderdata
This is the dataset used for training StarCoder and StarCoderBase. It contains 783GB of code in 86 programming languages, and includes 54GB GitHub Issues + 13GB Jupyter…
557 likes15,801 downloads in the last 30 daysText generationOther licenseGated
Rank 127: bigcode/the-stack-dedup
Initial release of the Stack. Included 30 programming languages and 18 permissive licenses. Note: Three included licenses (MPL/EPL/LGPL) are considered weak copyleft lic…
413 likes14,303 downloads in the last 30 daysText generationOther licenseGated
Rank 329: bigcode/ta-prompt
This repository is dedicated to prompts used to perform in-context learning with starcoder. As a matter of fact, the model is an autoregressive language model that is tr…
208 likes130 downloads in the last 30 daysApache 2.0
Rank 680: bigcode/commitpackft
CommitPackFT is is a 2GB filtered version of CommitPack to contain only high-quality commit messages that resemble natural language instructions.
115 likes37,253 downloads in the last 30 daysMIT