Data · dataset · 2024
LORELEI Uyghur Incident Language Pack
Listed in UC Berkeley Library Dataverse
Description
LORELEI Uyghur Incident Language Pack (LDC2024T07) was developed by the Linguistic Data Consortium and consists of approximately 28 million words of Uyghur monolingual text, 500,000 words of English monolingual text, 3.3 million words of parallel and comparable Uyghur-English text, and 200,000 words of data annotated for Simple Named Entities and Situation Frames. It contains all of the text data, annotations, supplemental resources and related software tools for the Uyghur language that were used in the DARPA LORELEI / LoReHLT 2016 Evaluation.
The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources.
Read the rest (3 more)
Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. The evaluation protocol was based on a scenario in which an unforeseen event triggered a need for humanitarian and logistical support in a region where the incident language had received little or no attention in natural language processing (NLP) research.
Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with very little time for development. Cite dataset as: Tracey, Jennifer, et al. LORELEI Uyghur Incident Language Pack LDC2024T07. Web Download.
Philadelphia: Linguistic Data Consortium, 2024.
Links
Where it is published
- Dataverse dataset page datasets.lib.berkeley.edu/dataset.xhtml?persistentId=doi%3A10.60503%2FD3%2F1LO8DZ ↗
landing page · from datasets lib berkeley edu
- DOI doi.org/10.60503/d3/1lo8dz ↗
DOI / persistent id · from datasets lib berkeley edu
Catalogue records · 1
- Dataverse API datasets.lib.berkeley.edu/api/datasets/:persistentId/?persistentId=doi%3A10.60503%2FD3%2… ↗
metadata API · from datasets lib berkeley edu
Topics
- Stated by source
- Social Sciences
- From keywords
- Social Science
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| UC Berkeley Library Dataverse | doi:10.60503/D3/1LO8DZ | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[disease].local:disease:disease | enrichment · datasets lib berkeley edu | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[field].dataverse_subject:social-sciences | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /subjects |
| concepts[modality].local:modality:text | enrichment · datasets lib berkeley edu | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| description | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /description |
| publication_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| title | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | /name |
| updated_date | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 | |
| version_label | source · datasets lib berkeley edu | connector:datasets_lib_berkeley_edu@1.0.0 |