Text · dataset · 2026
CordisBench
Listed in Hugging Face Datasets
CordisBench CordisBench tests whether language models can reason about the consequences of component lifecycle changes in dynamic agent harnesses.
Description
Each record contains an exact, programmatically generated oracle. Set-valued tasks use Jaccard similarity, sequence prediction uses per-observable accuracy, and executable reconfiguration is checked by running the proposed lifecycle operations.
This repository packages the frozen V2.0.1 release from sileod/cordis-bench.… See the full description on the dataset page: huggingface.co/datasets/sileod/cordis-bench.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/sileod/cordis-bench ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/sileod/cordis-bench ↗
metadata API · from Hugging Face
Topics
- Stated by source
- question answering · text
- From keywords
- Computer Science & AI · Software engineering
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | sileod/cordis-bench | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |