Table · dataset · 2022
TruthfulQA
Listed in Hugging Face Datasets
Dataset Card for truthful_qa Dataset
Description
Summary
TruthfulQA is a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categories, including health, law, finance and politics. Questions are crafted so that some humans would answer falsely due to a false belief or misconception.
Read the rest (1 more)
To perform well, models must avoid generating false answers learned from imitating human texts.… See the full description on the dataset page: huggingface.co/datasets/truthfulqa/truthful_qa.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/truthfulqa/truthful_qa ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2109.07958 arxiv.org/abs/2109.07958 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/truthfulqa/truthful_qa ↗
metadata API · from Hugging Face
Topics
- Stated by source
- multiple choice · question answering · text · text generation
- From keywords
- Computer Science & AI
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | truthfulqa/truthful_qa | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:multiple-choice | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |