Text · dataset · 2023

0xDing/wikipedia-cn-20230720-filtered

Listed in Hugging Face Datasets

Description

本数据集基于中文维基2023年7月20日的dump存档。作为一项以数据为中心的工作，本数据集仅保留了 254,547条质量较高的词条内容。具体而言：过滤了Template, Category, Wikipedia, File, Topic, Portal, MediaWiki, Draft, Help等特殊类型的词条使用启发式的方法和自有的NLU模型过滤了一部分质量较低的词条过滤了一部分内容较为敏感或存在争议性的词条。进行了简繁转换和习惯用词转换，确保符合中国大陆地区的习惯用词。 This dataset is based on the Chinese Wikipedia dump archive from July 20th, 2023. As a data-centric effort, the dataset retains 254,574 high-quality entries. Specifically: Entries of special types such as Template, Category, Wikipedia, File, Topic… See the full description on the dataset page: huggingface.co/datasets/0xDing/wikipedia-cn-20230720-filtered.

Topics

Stated by source: text · text generation
From keywords: Computer Science & AI

Provenance · 1 source records, 10 field assertions

Source	Key	Last seen	Raw
Hugging Face Datasets	0xDing/wikipedia-cn-20230720-filtered	13 d ago	JSON v1

Field	Assertion	Extractor	Evidence
access_level	source · Hugging Face	connector:huggingface@1.0.0	/gated
concepts[field].local:field:computer-science-ai	mapping · Hugging Face	connector:huggingface@1.0.0
concepts[modality].hf_modality:text	source · Hugging Face	connector:huggingface@1.0.0
concepts[task].hf_task:text-generation	source · Hugging Face	connector:huggingface@1.0.0	/tags[task_categories:*]
created_date	source · Hugging Face	connector:huggingface@1.0.0
description	source · Hugging Face	connector:huggingface@1.0.0	/description
license_text	source · Hugging Face	connector:huggingface@1.0.0
publication_date	source · Hugging Face	connector:huggingface@1.0.0
title	source · Hugging Face	connector:huggingface@1.0.0	/id
updated_date	source · Hugging Face	connector:huggingface@1.0.0

0xDing/wikipedia-cn-20230720-filtered

Description

Links

Where it is published

Topics