← Search

Text · dataset · 2023

Unified-Language-Model-Alignment/Anthropic_HH_Golden

Listed in Hugging Face Datasets

Dataset Card for Anthropic_HH_Golden This dataset is constructed to test the ULMA technique as mentioned in the paper Unified Language Model Alignment with Demonstration and Point-wise Human Preference (under review, and an arxiv link will be provided soon).

Description

They show that replacing the positive samples in a preference dataset by high-quality demonstration data (golden data) greatly improves the performance of various alignment methods (RLHF, DPO, ULMA).

In particular, the ULMA… See the full description on the dataset page: huggingface.co/datasets/Unified-Language-Model-Alignment/Anthropic_HH_Golden.

Links

Topics

Stated by source
text
Provenance · 1 source records, 9 field assertions
SourceKeyLast seenRaw
Hugging Face DatasetsUnified-Language-Model-Alignment/Anthropic_HH_Golden15 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · Hugging Faceconnector:huggingface@1.0.0/gated
concepts[field].local:field:computer-science-aimapping · Hugging Faceconnector:huggingface@1.0.0
concepts[modality].hf_modality:textsource · Hugging Faceconnector:huggingface@1.0.0
created_datesource · Hugging Faceconnector:huggingface@1.0.0
descriptionsource · Hugging Faceconnector:huggingface@1.0.0/description
licensesource · Hugging Faceconnector:huggingface@1.0.0/tags[license:*]
publication_datesource · Hugging Faceconnector:huggingface@1.0.0
titlesource · Hugging Faceconnector:huggingface@1.0.0/id
updated_datesource · Hugging Faceconnector:huggingface@1.0.0