Data · dataset · 2016
Compressing an Ensemble With Statistical Models: An Algorithm for Global 3D Spatio-Temporal Temperature
Listed in DataCite
One of the main challenges when working with modern climate model ensembles is the increasingly larger size of the data produced, and the consequent difficulty in storing large amounts of spatio-temporally resolved information.
Description
Many compression algorithms can be used to mitigate this problem, but since they are designed to compress generic scientific datasets, they do not account for the nature of climate model output and they compress only individual simulations.
In this work, we propose a different, statistics-based approach that explicitly accounts for the space-time dependence of the data for annual global three-dimensional temperature fields in an initial condition ensemble. The set of estimated parameters is small (compared to the data size) and can be regarded as a summary of the essential structure of the ensemble output; therefore, it can be used to instantaneously reproduce the temperature fields in an ensemble with a substantial saving in storage and time.
Read the rest (1 more)
The statistical model exploits the gridded geometry of the data and parallelization across processors. It is therefore computationally convenient and allows to fit a nontrivial model to a dataset of 1 billion data points with a covariance matrix comprising of 10 18 entries. Supplementary materials for this article are available online.
Links
Where it is published
- Repository landing page tandf.figshare.com/articles/dataset/Compressing_an_Ensemble_with_Statistical_Mode… ↗
landing page · from DataCite
- DOI doi.org/10.6084/m9.figshare.1378931 ↗
DOI / persistent id · from DataCite
Documentation and papers
- Creative Commons Attribution 4.0 International creativecommons.org/licenses/by/4.0/legalcode ↗
license · from DataCite
- IsSupplementTo 10.1080/00401706.2015.1027068 doi.org/10.1080/00401706.2015.1027068 ↗
publication · from DataCite
Catalogue records · 2
- DataCite API api.datacite.org/dois/10.6084/m9.figshare.1378931 ↗
metadata API · from DataCite
- DataCite Commons commons.datacite.org/doi.org/10.6084/m9.figshare.1378931 ↗
catalogue entry · from DataCite
Topics
- Stated by source
- Biological sciences · Computer and information sciences · Mathematics
- Inferred from text
- Climate model simulation 65%
Provenance · 1 source records, 12 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| DataCite | 10.6084/m9.figshare.1378931 | 14 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| byte_size | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:biological-sciences | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:computer-and-information-sciences | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:mathematics | source · DataCite | connector:datacite@1.0.0 | |
| concepts[method].local:method:climate-model | enrichment · DataCite | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · DataCite | connector:datacite@1.0.0 | |
| description | source · DataCite | connector:datacite@1.0.0 | /data/attributes/descriptions |
| license | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| publication_date | source · DataCite | connector:datacite@1.0.0 | /data/attributes/dates |
| title | source · DataCite | connector:datacite@1.0.0 | /data/attributes/titles/0/title |
| updated_date | source · DataCite | connector:datacite@1.0.0 |