Text · dataset · 2022
Evaluations from "Discovering Language Model Behaviors with Model-Written Evaluations"
Listed in Hugging Face Datasets
Description
Model-Written Evaluation Datasets This repository includes datasets written by language models, used in our paper on "Discovering Language Model Behaviors with Model-Written Evaluations." We intend the datasets to be useful to: Those who are interested in understanding the quality and properties of model-generated data Those who wish to use our datasets to evaluate other models for the behaviors we examined in our work (e.g., related to model persona, sycophancy, advanced AI risks… See the full description on the dataset page: huggingface.co/datasets/Anthropic/model-written-evals.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/Anthropic/model-written-evals ↗
landing page · from Hugging Face
Documentation and papers
- arXiv:1804.09301 arxiv.org/abs/1804.09301 ↗
publication · from Hugging Face
- arXiv:2212.09251 arxiv.org/abs/2212.09251 ↗
publication · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/Anthropic/model-written-evals ↗
metadata API · from Hugging Face
Topics
- Stated by source
- multiple choice · question answering · text · zero shot classification
- From keywords
- Computer Science & AI
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | Anthropic/model-written-evals | 8 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[task].hf_task:multiple-choice | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:question-answering | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| concepts[task].hf_task:zero-shot-classification | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |