Data · dataset · 2026
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Listed in National Center for Atmospheric Research
Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations.
Description
By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date.
The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Ni & ntilde;o-Southern Oscillation (ENSO) and Madden-Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes.
Read the rest (2 more)
The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble.
Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.
Links
Get the data
- Publisher page n2t.org/ark:/85065/d76w9g96 ↗
documentation · download · from data ucar edu
Where it is published
- data.ucar.edu /dataset/systematic-and-objective-evaluation-of-earth-system-mo… ↗
National Center for Atmospheric Research dataset page
landing page · from data ucar edu
Catalogue records · 1
- CKAN API data.ucar.edu/api/3/action/package_show?id=4667f839-ebef-4d95-953e-611130bb4… ↗
metadata API · from data ucar edu
Topics
- From keywords
- Earth & Environmental Science · Ocean & Atmospheric Science
- Inferred from text
- Climate model simulation 65% · Geoinformatics 71%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| National Center for Atmospheric Research | 4667f839-ebef-4d95-953e-611130bb43ce | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:3704 | enrichment · data ucar edu | taxonomy-embedding@1.1.0 | title+keywords+description (71%) |
| concepts[field].local:field:earth-environmental | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[method].local:method:climate-model | enrichment · data ucar edu | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| description | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /notes |
| publication_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| title | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /title |
| updated_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 |