Table · dataset · 2022
NeelNanda/c4-code-20k
Listed in Hugging Face Datasets
Dataset Card for "c4-code-10k" 10K elements of C4 and 10K elements of code parrot clean (Python code).
Description
Note that these are the datasets used to train my interpretability-friendly models, but is not of the correct mixture. Those models were trained on 83% C4 and 17% Python Code (ish) by tokens.
This dataset has 10K strings of each, and by tokens is about 22M of code and 5M of C4 (code is longer and harder to compress!) More Information needed
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/NeelNanda/c4-code-20k ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/NeelNanda/c4-code-20k ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text
- From keywords
- Computer Science & AI
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | NeelNanda/c4-code-20k | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |