Data · dataset · 2022
Message Understanding Conference (MUC) 7
Listed in Borealis and Agri-environmental Research Data Dataverse — shown once because both records carry DOI 10.5683/sp2/eq7ftz
Introduction Message Understanding Conference (MUC) 7 was produced by Linguistic Data Consortium (LDC) catalog number LDC2001T02 and ISBN 1-58563-205-8.
Description
In the 1990s, the MUC evaluations funded the development of metrics and statistical algorithms to support government evaluations of emerging information extraction technologies. Additional information from NIST can be found here.
Data The following list shows the correspondence between versions of the IE task definition and stages of the MUC-7 evaluation. Version #Stage 4.1 training and dryrun 4.2 formalrun 5.1 final The dryrun and formalrun have different domains; the dryrun (and training) consists of aircrashes scenarios and the formalrun consists of missile launches scenarios. The final version updates especially the Template Relations portion of the guidelines.
Read the rest (4 more)
Normally, for each scenario, two datasets are provided: training and test. When the evaluation cycle begins, the label for the scenario dataset is training. Then the corresponding test dataset for that same scenario is used for the dryrun testing.
For the formal run, a formal training set is given out four weeks before the test answers are due. The formal test is given out one week before the test answers are due. After the entire evaluation and meeting have been held, final edits are made if necessary.
Samples Please view this text sample. Updates August 22, 2001: This publication was inadvertently released without the guidelines documentation and the scoring software. These documents and programs have now been added to the publication and if you previously purchased this corpus and would like to download a complete copy of the corpus please contact ldc@ldc.upenn.edu.
Copyright Portions © 1996 New York Times, © 2001 Trustees of the University of Pennsylvania
Links
Where it is published
- Dataverse dataset page borealisdata.ca/dataset.xhtml?persistentId=doi%3A10.5683%2FSP2%2FEQ7FTZ ↗
landing page · from borealisdata ca
- DOI doi.org/10.5683/sp2/eq7ftz ↗
DOI / persistent id · from borealisdata ca
Catalogue records · 1
- Dataverse API borealisdata.ca/api/datasets/:persistentId/?persistentId=doi%3A10.5683%2FSP2%2… ↗
metadata API · from borealisdata ca
Topics
- Stated by source
- Arts and Humanities · Arts and Humanities
- From keywords
- Chemistry · Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Humanities · Humanities · Life Sciences · Mathematics & Statistics · Medicine & Health · Ocean & Atmospheric Science · Social Science
- Inferred from text
- Text 75%
Provenance · 2 source records, 21 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Borealis | doi:10.5683/SP2/EQ7FTZ | 5 d ago | JSON v1 |
| Agri-environmental Research Data Dataverse | doi:10.5683/SP2/EQ7FTZ | 4 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].dataverse_subject:arts-and-humanities | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /subjects |
| concepts[field].dataverse_subject:arts-and-humanities | source · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:chemistry | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:computer-science-ai | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:earth-environmental | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:economics-finance | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:engineering | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:humanities | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:humanities | mapping · borealisdata ca | connector:borealisdata_ca@1.0.0 | /subjects |
| concepts[field].local:field:life-sciences | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:mathematics-statistics | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:medicine-health | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:ocean-atmospheric | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[field].local:field:social-science | mapping · borealisdata ca dataverse | connector:borealisdata_ca_dataverse@1.0.0 | /subjects |
| concepts[modality].local:modality:text | enrichment · borealisdata ca | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| description | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /description |
| publication_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| title | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | /name |
| updated_date | source · borealisdata ca | connector:borealisdata_ca@1.0.0 | |
| version_label | source · borealisdata ca | connector:borealisdata_ca@1.0.0 |