Text · dataset · 2022
r-three/fib
Listed in Hugging Face Datasets
Dataset Card for FIB Dataset
Description
Summary
The FIB benchmark consists of 3579 examples for evaluating the factual inconsistency of large language models. Each example consists of a document and a pair of summaries: a factually consistent one and a factually inconsistent one. It is based on documents and summaries from XSum and CNN/DM.
Read the rest (1 more)
Since this dataset is intended to evaluate the factual inconsistency of large language models, there is only a test split. Accuracies should be… See the full description on the dataset page: huggingface.co/datasets/r-three/fib.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/r-three/fib ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2211.08412 arxiv.org/abs/2211.08412 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/r-three/fib ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | r-three/fib | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |