mrcr
by openai (organization)
OpenAI MRCR: Long context multiple needle in a haystack benchmark OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's ability to distinguish between multiple needles hidden in context. This eval is inspired by the MRCR eval… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- openai/mrcr
- Likes
- 229
- Downloads (last 30 days)
- 9,512
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 1K to 10K examples
- License
- MIT (mit)
- Access
- Open download
- Author
- openai · Organization
- Languages
- Not given
- Created
- Apr 11, 2025
- Last modified
- Dec 8, 2025
More datasets from openai
Rank 4: openai/gsm8k
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of que…
2,005 likes1,003,669 downloads in the last 30 daysText generationMIT
Rank 71: openai/gdpval
Dataset for GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks. Paper | Blog | Site 220 real-world knowledge tasks across 44 occupations.…
562 likes308,395 downloads in the last 30 daysNo license given
Rank 77: openai/MMMLU
Multilingual Massive Multitask Language Understanding (MMMLU) The MMLU is a widely recognized benchmark of general knowledge attained by AI models. It covers a broad ran…
534 likes13,640 downloads in the last 30 daysQuestion answeringMIT
Rank 129: openai/openai_humaneval
The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to…
410 likes241,321 downloads in the last 30 daysMIT
Rank 260: openai/webgpt_comparisons
WebGPT Comparisons contains all of the comparisons marked as suitable for reward modelling from the WebGPT paper.
247 likes1,064 downloads in the last 30 daysNo license given
Rank 292: openai/summarize_from_feedback
Summarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.
230 likes3,828 downloads in the last 30 daysNo license given