Table · dataset · 2022
HateCheck
Listed in Hugging Face Datasets
Dataset Card for HateCheck Dataset Description HateCheck is a suite of functional test for hate speech detection models.
Description
The dataset contains 3,728 validated test cases in 29 functional tests. 19 functional tests correspond to distinct types of hate. The other 11 functional tests cover challenging types of non-hate.
This allows for targeted diagnostic insights into model performance. In our ACL paper, we found critical weaknesses in all commercial and academic hate… See the full description on the dataset page: huggingface.co/datasets/Paul/hatecheck.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/Paul/hatecheck ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:2012.15606 arxiv.org/abs/2012.15606 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/Paul/hatecheck ↗
metadata API · from Hugging Face
Topics
- Stated by source
- tabular · text · text classification
- From keywords
- Computer Science & AI
- Inferred from text
- Audio 65%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | Paul/hatecheck | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:tabular | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:audio | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[task].hf_task:text-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |