Constarium
← Search

Text · dataset · 2026

DecisionBench

Listed in Hugging Face Datasets

DecisionBench DecisionBench tests how well AI models read a situation and answer questions about it.

Description

Each model gets the same information, rules, and answer choices. Questions ask for a yes/no answer, a choice from a list, or a rating.

There are two sets: medium, with explicit rules, and hard, with more judgment calls. Each has 80 situations and 293 questions. The chart compares how often each model matches the answer key and how much the API requests cost.

Read the rest (1 more)

Accuracy is… See the full description on the dataset page: huggingface.co/datasets/akhilaaa3/decision-bench.

Links

Where it is published

Catalogue records · 1

Topics

Stated by source
text
Provenance · 1 source records, 9 field assertions
SourceKeyLast seenRaw
Hugging Face Datasetsakhilaaa3/decision-bench13 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:textsource · Hugging Faceconnector:huggingface@1.0.0
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
licensesource · Hugging Faceconnector:huggingface@1.0.0/tags[license:*]
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0