openai_humaneval
by openai (organization)
The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models. Supported Tasks and Leaderboards… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- openai/openai_humaneval
- Likes
- 410
- Downloads (last 30 days)
- 241,321
- Tasks
- Not given
- Modality
- text
- Size
- Fewer than 1K examples
- License
- MIT (mit)
- Access
- Open download
- Author
- openai · Organization
- Languages
- en
- Created
- Mar 2, 2022
- Last modified
- Jan 4, 2024
More datasets from openai
Rank 4: openai/gsm8k
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of que…
2,005 likes1,003,669 downloads in the last 30 daysText generationMIT
Rank 71: openai/gdpval
Dataset for GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks. Paper | Blog | Site 220 real-world knowledge tasks across 44 occupations.…
562 likes308,395 downloads in the last 30 daysNo license given
Rank 77: openai/MMMLU
Multilingual Massive Multitask Language Understanding (MMMLU) The MMLU is a widely recognized benchmark of general knowledge attained by AI models. It covers a broad ran…
534 likes13,640 downloads in the last 30 daysQuestion answeringMIT
Rank 260: openai/webgpt_comparisons
WebGPT Comparisons contains all of the comparisons marked as suitable for reward modelling from the WebGPT paper.
247 likes1,064 downloads in the last 30 daysNo license given
Rank 292: openai/summarize_from_feedback
Summarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.
230 likes3,828 downloads in the last 30 daysNo license given
Rank 295: openai/mrcr
OpenAI MRCR: Long context multiple needle in a haystack benchmark OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's a…
229 likes9,512 downloads in the last 30 daysMIT