Data · dataset · 2022
MENYO-20k
Listed in Hugging Face Datasets
MENYO-20k is a multi-domain parallel dataset with texts obtained from news articles, ted talks, movie transcripts, radio transcripts, science and technology texts, and other short articles curated from the web and professional translators.
Description
The dataset has 20,100 parallel sentences split into 10,070 training sentences, 3,397 development sentences, and 6,633 test sentences (3,419 multi-domain, 1,714 news domain, and 1,500 ted talks speech transcript domain).
The development and test sets are available upon request.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/UdS-LSV/menyo20k_mt ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2103.08647 arxiv.org/abs/2103.08647 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/UdS-LSV/menyo20k_mt ↗
metadata API · from Hugging Face
Topics
- Stated by source
- translation
- From keywords
- Computer Science & AI
- Inferred from text
- Audio 65%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | UdS-LSV/menyo20k_mt | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:audio | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[task].hf_task:translation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |