Text · dataset · 2017
SPEECH-COCO
Listed in DataCite
SPEECH-COCO is an augmentation of MS-COCO dataset where speech is added to image and text.
Description
Speech captions were generated using text-to-speech (TTS) synthesis resulting in 616,767 spoken captions (>600h) paired with images. Disfluencies and speed perturbation were added to the signal in order to sound more natural.
Each speech signal (WAV) is paired with a JSON file containing exact timecode for each word/syllable/phoneme in the spoken caption. Such a corpus could be used for Language and Vision (LaVi) tasks including speech input or output instead of text.
Links
Where it is published
- Repository landing page perscido.univ-grenoble-alpes.fr/datasets/DS80 ↗
landing page · from DataCite
- DOI doi.org/10.18709/perscido.2017.06.ds80 ↗
DOI / persistent id · from DataCite
Documentation and papers
Catalogue records · 2
- DataCite API api.datacite.org/dois/10.18709/perscido.2017.06.ds80 ↗
metadata API · from DataCite
- DataCite Commons commons.datacite.org/doi.org/10.18709/perscido.2017.06.ds80 ↗
catalogue entry · from DataCite
Topics
- Stated by source
- Languages and literature
- From keywords
- Computer Science & AI
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| DataCite | 10.18709/perscido.2017.06.ds80 | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| byte_size | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:languages-and-literature | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · DataCite | vocabulary-mapper@1.0.0 | keywords['Computer Science'] |
| concepts[modality].local:modality:audio | enrichment · DataCite | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].local:modality:image | enrichment · DataCite | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:text | enrichment · DataCite | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · DataCite | connector:datacite@1.0.0 | /data/attributes/descriptions |
| license | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| publication_date | source · DataCite | connector:datacite@1.0.0 | /data/attributes/dates |
| title | source · DataCite | connector:datacite@1.0.0 | /data/attributes/titles/0/title |
| version_label | source · DataCite | connector:datacite@1.0.0 |