← Search

Data · dataset · 2022

MayaGalvez/linguistic_representation_mBERT

Listed in Hugging Face Datasets

This dataset obtains genealogical and typological information for the 104 languages used for pre-training of the language model multilingual BERT (Devlin et al., 2019).

Description

The genealogical information covers the language family and the genus for each language. For typological description of the pre-training languages, 36 features from WALS (Dryer & Haspelmath, 2013) were used.

The information provided here can be used, among other things, to investigate how the pre-training corpus is structured… See the full description on the dataset page: huggingface.co/datasets/MayaGalvez/linguistic_representation_mBERT.

Links

Topics

Stated by source
document
Inferred from text
Artificial intelligence 70%
Provenance · 1 source records, 9 field assertions
SourceKeyLast seenRaw
Hugging Face DatasetsMayaGalvez/linguistic_representation_mBERT15 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].anzsrc:group:4602enrichment · Hugging Facetaxonomy-embedding@1.1.0title+keywords+description (70%)
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:documentsource · Hugging Faceconnector:huggingface@1.0.0
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0