Table · dataset · 2022
github-jupyter-text-code-pairs
Listed in Hugging Face Datasets
This is a parsed version of github-jupyter-parsed, with markdown and code pairs.
Description
We provide the preprocessing script in preprocessing.py. The data is deduplicated and consists of 451662 examples.
For similar datasets with text and Python code, there is CoNaLa benchmark from StackOverflow, with some samples curated by annotators.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/codeparrot/github-jupyter-text-code-pairs ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/codeparrot/github-jupyter-text-code-pairs ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · text generation
- From keywords
- Computer Science & AI
- Inferred from text
- Text 75%
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | codeparrot/github-jupyter-text-code-pairs | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:text-generation | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |