Data · dataset · 2019
A Chinese-Uighur comparable corpus
Listed in ScienceDB
The construction of corpus is an important task in natural language processing.
Description
However, the scale of parallel corpus does not meet the actual needs, especially in Uighur information processing. Therefore, the work of obtaining Chinese-Uighur corpus from the Internet plays an important role in the construction of Chinese-Uighur bilingual resources and the promotion of ethnic exchanges.
This paper studies and designs a Chinese-Uighur comparable corpus mining system in view of the complex Uyghur and the great differences between Chinese and Uighur language forms. This system mainly includes web content extraction, acquisition of candidate comparable corpora and the cross-language similarity calculation. At present, there are more than 5000 comparable Chinese and Uygur texts, mainly in the field of news and government documents.
Read the rest (1 more)
The corpus plays an important role in the analysis and teaching of minority languages and Chinese-Uygur machine translation. For the convenience of use, this data set has further processed and normalized Chinese and Uighur language.
Links
Where it is published
- DOI doi.org/10.11922/sciencedb.748 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.11922%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Earth & Environmental Science · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Corpus linguistics 76%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.11922/sciencedb.748 | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:field:470404 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (76%) |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |