Table · dataset · 2026
claimcheck-bench: Agent Success-Claim Verification
Listed in Hugging Face Datasets
claimcheck-bench A synthetic benchmark for checking whether an AI agent's success claim is supported by its tool results and environment state.
Description
An agent can say “done” after a failed write, an action on the wrong record, or an operation that never persisted. This dataset contains 300 labelled agent traces for evaluating detectors that distinguish successful completion from false success claims across booking, CRM, and coding tasks.
Created by Andrii Boiko as part of… See the full description on the dataset page: huggingface.co/datasets/aboiko/claimcheck-bench.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/aboiko/claimcheck-bench ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/aboiko/claimcheck-bench ↗
metadata API · from Hugging Face
Topics
- Stated by source
- text · text classification
- From keywords
- Computer Science & AI · Text
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | aboiko/claimcheck-bench | 6 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:text | mapping · Hugging Face | vocabulary-mapper@1.0.0 | keywords['text'] |
| concepts[task].hf_task:text-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |