← Search

Table · dataset · 2022

heegyu/namuwiki-extracted

Listed in Hugging Face Datasets

Description

namu.wiki database dump namu.wiki/ database dump 2022/03/01 571308rows download size: 2.19GB 주의사항 namu-wiki-extractor를 이용하여 전처리, 추가로 아래 전처리를 수행했습니다 헤더 제거 == 개요 == 테이블 제거 [age(1997-01-01)] 는 전처리 시점 기준으로 적용(2022년 10월 2일) [math(a / b + c)] 는 제거하지 않음. math 마크다운이 각주 내에 있을 경우, 각주가 전처리되지 않은 문제 있음. Usage pip install datasets from datasets import load_dataset dataset = load_dataset("heegyu/namuwiki-extracted") print(dataset["train"][0]) {… See the full description on the dataset page: huggingface.co/datasets/heegyu/namuwiki-extracted.

Links

Where it is published

Catalogue records · 1

Topics

Stated by source
other · text
Provenance · 1 source records, 10 field assertions
SourceKeyLast seenRaw
Hugging Face Datasetsheegyu/namuwiki-extracted15 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:textsource · Hugging Faceconnector:huggingface@1.0.0
concepts[task].hf_task:othersource · Hugging Faceconnector:huggingface@1.0.0/tags[task_categories:*]
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
license_textsource · Hugging Faceconnector:huggingface@1.0.0
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0