Table · dataset · 2024
Wikipedia and Simple Wikipedia Lead Section Pairs for Nine Categories
Listed in INESC TEC Research Data Repository
Description
The dataset (categorized_dataset folder) contains 9 files in .csv format, each a collection of 10,000 lead section pairs sourced from Wikipedia (wikipedia.org/) and Simple Wikipedia (simple.wikipedia.org/) for a given category. Included categories are Culture, Education, Employment, Entertainment, Health, Leisure, Objects, Science and Time. This dataset was created to understand how effective an open-source large language model (Llama3) is in assessing the readability of texts and simplifying text across multiple domains.
The dataset was collected using Wikipedia API.
Links
Get the data
- Categorized dataset rdm.inesctec.pt/dataset/32b5f276-f5de-4a2e-a5ba-aac43f263659/resource/6fb2ce3b… ↗
download · from rdm inesctec pt
- Model responses rdm.inesctec.pt/dataset/32b5f276-f5de-4a2e-a5ba-aac43f263659/resource/a3bd8e54… ↗
download · from rdm inesctec pt
- README rdm.inesctec.pt/dataset/32b5f276-f5de-4a2e-a5ba-aac43f263659/resource/db1073a7… ↗
download · from rdm inesctec pt
- Full Dataset rdm.inesctec.pt/dataset/32b5f276-f5de-4a2e-a5ba-aac43f263659/resource/ae7d1337… ↗
download · from rdm inesctec pt
Where it is published
- INESC TEC Research Data Repository dataset page rdm.inesctec.pt/dataset/cs-2024-008 ↗
landing page · from rdm inesctec pt
Catalogue records · 1
- CKAN API rdm.inesctec.pt/api/3/action/package_show?id=32b5f276-f5de-4a2e-a5ba-aac43f263… ↗
metadata API · from rdm inesctec pt
Topics
- Stated by source
- CS: Computer Science
- From keywords
- Computer Science & AI · Engineering · Humanities
- Inferred from text
- Text 75%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| INESC TEC Research Data Repository | 32b5f276-f5de-4a2e-a5ba-aac43f263659 | 5 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:engineering | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[field].local:field:humanities | mapping · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · rdm inesctec pt | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[topic].ckan_group:rdm_inesctec_pt:cs-computer-science | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| created_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| description | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /notes |
| license_text | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| publication_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | |
| title | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 | /title |
| updated_date | source · rdm inesctec pt | connector:rdm_inesctec_pt@1.0.0 |