frames-benchmark
by google (organization)
FRAMES: Factuality, Retrieval, And reasoning MEasurement Set FRAMES is a comprehensive evaluation dataset designed to test the capabilities of Retrieval-Augmented Generation (RAG) systems across factuality, retrieval accuracy, and reasoning. Our paper with details and… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- google/frames-benchmark
- Likes
- 271
- Downloads (last 30 days)
- 25,122
- Tasks
- Text classification, Token classification, Table question answering, Question answering
- Modality
- text
- Size
- Fewer than 1K examples
- License
- Apache 2.0 (apache-2.0)
- Access
- Open download
- Author
- google · Organization
- Languages
- en
- Created
- Sep 19, 2024
- Last modified
- Oct 15, 2024
More datasets from google
Rank 92: google/fleurs
Fleurs is the speech version of the FLoRes machine translation benchmark. We use 2009 n-way parallel sentences from the FLoRes dev and devtest publicly available sets, i…
488 likes147,521 downloads in the last 30 daysSpeech recognitionCC BY 4.0
Rank 203: google/WaxalNLP
The WAXAL dataset is a large-scale multilingual speech corpus for African languages, introduced in the paper WAXAL: A Large-Scale Multilingual African Language Speech Co…
298 likes9,625 downloads in the last 30 daysSpeech recognitionCC BY-SA 4.0
Rank 213: google/mobile-actions
Mobile Actions: A Dataset for On-Device Function Calling The dataset contains conversational traces designed to train lightweight models (such as FunctionGemma 270M) to…
289 likes877 downloads in the last 30 daysCC BY 4.0
Rank 410: google/IFEval
This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" s…
180 likes165,280 downloads in the last 30 daysText generationApache 2.0
Rank 484: google/MusicCaps
The MusicCaps dataset contains 5,521 music examples, each of which is labeled with an English aspect list and a free text caption written by musicians. An aspect list is…
159 likes1,307 downloads in the last 30 daysText to speechCC BY-SA 4.0
Rank 527: google/Synthetic-Persona-Chat
Abstract from the paper introducing this dataset: High-quality conversational datasets are essential for developing AI models that can communicate with users. One way to…
143 likes3,550 downloads in the last 30 daysCC BY 4.0