Table · dataset · 2022
Measuring Massive Multitask Language Understanding
Listed in Hugging Face Datasets
Dataset Card for MMLU Dataset
Description
Summary
Measuring Massive Multitask Language Understanding by Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt (ICLR 2021). This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge. The test spans subjects in the humanities, social sciences, hard sciences, and other areas that are important for some people to learn.
Read the rest (1 more)
This covers 57… See the full description on the dataset page: huggingface.co/datasets/cais/mmlu.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/cais/mmlu ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2009.03300 arxiv.org/abs/2009.03300 ↗
publication · from Hugging Face
- arXiv:2005.00700 arxiv.org/abs/2005.00700 ↗
publication · from Hugging Face
- arXiv:2005.14165 arxiv.org/abs/2005.14165 ↗
publication · from Hugging Face
- arXiv:2008.02275 arxiv.org/abs/2008.02275 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/cais/mmlu ↗
metadata API · from Hugging Face
Topics
- Stated by source
- question answering · text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | cais/mmlu | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |