Table · dataset · 2022
KcBERT Pre-Training Corpus (Korean News Comments)
Listed in Hugging Face Datasets
Description
KcBERT Pre-Training Corpus (Korean News Comments) KcBERT beomi/kcbert-base Github KcBERT Repo: github.com/Beomi/KcBERTKcBERT is Korean Comments BERT pretrained on this Corpus set.(You can use it via Huggingface's Transformers library!) This Kaggle Dataset contains CLEANED dataset preprocessed with the code below. import re import emoji from soynlp.normalizer import repeat_normalize emojis = ''.join(emoji.UNICODE_EMOJI.keys()) pattern = re.compile(f'[^ .… See the full description on the dataset page: huggingface.co/datasets/Bingsu/KcBERT_Pre-Training_Corpus.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/Bingsu/KcBERT_Pre-Training_Corpus ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/Bingsu/KcBERT_Pre-Training_Corpus ↗
metadata API · from Hugging Face
Topics
- Stated by source
- fill mask · text · text generation
- From keywords
- Computer Science & AI
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | Bingsu/KcBERT_Pre-Training_Corpus | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:fill-mask | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |