Data · dataset · 2023
Legal CaPER Benchmark
Listed in TU Wien Research Data
The Legal Ca se P assage E xtraction and R etrieval benchmark is an information retrieval benchmark collection for court case passage retrieval.
Description
Specifically, it is a collection for evaluating Cited Case Passage Retrieval (CCPR) and contains case passages from the Austrian building regulations domain (Source: RIS). The following files are included in the dataset: full_collection.tsv A tab separated file containing the passage texts of court cases from the building regulations domain.
Column 1 contains the ID of the passage, Column 2 contains the passage text and Column 3 contains the case ID (Geschäftszahl) of the origin case of the passage. queries.tsv A tab separated file containing the queries / topics for which relevance assessments exist in this collection. Column 1 contains the ID of the query, Column 2 contains the query passage text and Column 3 contains the case ID (Geschäftszahl) of the cited case.
Read the rest (2 more)
For the task of CCPR, it is intended that results are additionally filtered based on exact matches of the case ID. For each query, only relevance assessments exist for passages that match the case ID of column 3. qrel.json Contains relevance assessments for each query. In this dictionary, a passage from the full collection is relevant for a query if qrel[<query ID>][<passage ID>] == 1.
If a passage ID is not in qrel[<query ID>], it is not relevant. Relevance assessments only exist for full collection passages that match the case ID of the query. qrel.json.txt A conversion of the qrel.json file to be compatible with trec eval.
Links
Where it is published
- TU Wien Research Data record researchdata.tuwien.ac.at/records/5caar-3r468 ↗
landing page · from researchdata tuwien ac at
- DOI doi.org/10.48436/5caar-3r468 ↗
DOI / persistent id · from researchdata tuwien ac at
Catalogue records · 1
- InvenioRDM API researchdata.tuwien.ac.at/api/records/5caar-3r468 ↗
metadata API · from researchdata tuwien ac at
Topics
- Inferred from text
- Text 75%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| TU Wien Research Data | 5caar-3r468 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · researchdata tuwien ac at | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | /metadata/description |
| license | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | |
| publication_date | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | |
| title | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | /metadata/title |
| updated_date | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 | |
| version_label | source · researchdata tuwien ac at | connector:researchdata_tuwien_ac_at@1.0.0 |