the-stack-dedup
by bigcode (organization)
Initial release of the Stack. Included 30 programming languages and 18 permissive licenses. Note: Three included licenses (MPL/EPL/LGPL) are considered weak copyleft licenses. The resulting near-deduplicated dataset is 1.5TB in size. v1.1 The three copyleft licenses… (excerpt from the dataset card on Hugging Face)
Access requires accepting terms on Hugging Face.
Dataset facts
- Hub id
- bigcode/the-stack-dedup
- Likes
- 413
- Downloads (last 30 days)
- 14,303
- Tasks
- Text generation
- Modality
- tabular, text
- Size
- 100M to 1B examples
- License
- Other license
- Access
- Gated: access is granted on accepting the terms
- Author
- bigcode · Organization
- Languages
- Not given
- Created
- Oct 6, 2022
- Last modified
- Aug 17, 2023
More datasets from bigcode
Rank 21: bigcode/the-stack
Initial release of the Stack. Included 30 programming languages and 18 permissive licenses. Note: Three included licenses (MPL/EPL/LGPL) are considered weak copyleft lic…
1,088 likes7,687 downloads in the last 30 daysText generationOther licenseGated
Rank 59: bigcode/the-stack-v2
The dataset consists of 4 versions: bigcode/the-stack-v2: the full "The Stack v2" dataset -- you are here bigcode/the-stack-v2-dedup: based on the bigcode/the-stack-v2 b…
653 likes6,787 downloads in the last 30 daysText generationOther licenseGated
Rank 72: bigcode/starcoderdata
This is the dataset used for training StarCoder and StarCoderBase. It contains 783GB of code in 86 programming languages, and includes 54GB GitHub Issues + 13GB Jupyter…
557 likes15,801 downloads in the last 30 daysText generationOther licenseGated
Rank 329: bigcode/ta-prompt
This repository is dedicated to prompts used to perform in-context learning with starcoder. As a matter of fact, the model is an autoregressive language model that is tr…
208 likes130 downloads in the last 30 daysApache 2.0
Rank 526: bigcode/the-stack-v2-dedup
The dataset consists of 4 versions: bigcode/the-stack-v2: the full "The Stack v2" dataset bigcode/the-stack-v2-dedup: based on the bigcode/the-stack-v2 but further near-…
143 likes2,531 downloads in the last 30 daysText generationOther licenseGated
Rank 680: bigcode/commitpackft
CommitPackFT is is a 2GB filtered version of CommitPack to contain only high-quality commit messages that resemble natural language instructions.
115 likes37,253 downloads in the last 30 daysMIT