Table · dataset · 2022
wikimedia/wikisource
Listed in Hugging Face Datasets
Dataset Card for Wikimedia Wikisource Dataset
Description
Summary
Wikisource dataset containing cleaned articles of all languages. The dataset is built from the Wikisource dumps (dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikisource text with cleaning to strip markdown and unwanted sections (references, etc.).
Read the rest (1 more)
All language subsets have already been processed for recent dump, and you… See the full description on the dataset page: huggingface.co/datasets/wikimedia/wikisource.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/wikimedia/wikisource ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/wikimedia/wikisource ↗
metadata API · from Hugging Face
Topics
- Stated by source
- fill mask · text · text generation
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | wikimedia/wikisource | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:fill-mask | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |