Table · dataset · 2022
MultiPLE-E
Listed in Hugging Face Datasets
Dataset Card for MultiPL-E Dataset
Description
Summary
MultiPL-E is a dataset for evaluating large language models for code generation that supports 22 programming languages. It takes the OpenAI HumanEval and the Mostly Basic Python Programs (MBPP) benchmarks and uses little compilers to translate them to other languages. It is easy to add support for new languages and benchmarks.
Read the rest (1 more)
The dataset is divided into several configurations named SRCDATA-LANG, where SRCDATA is either… See the full description on the dataset page: huggingface.co/datasets/nuprl/MultiPL-E.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/nuprl/MultiPL-E ↗
landing page · from Hugging Face
- DOI doi.org/10.57967/hf/4446 ↗
DOI / persistent id · from Hugging Face
Documentation and papers
- arXiv:2301.03988 arxiv.org/abs/2301.03988 ↗
publication · from Hugging Face
- arXiv:2305.06161 arxiv.org/abs/2305.06161 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/nuprl/MultiPL-E ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | nuprl/MultiPL-E | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |