← Search

Data · dataset · 2016

Compressing an Ensemble With Statistical Models: An Algorithm for Global 3D Spatio-Temporal Temperature

Listed in DataCite

One of the main challenges when working with modern climate model ensembles is the increasingly larger size of the data produced, and the consequent difficulty in storing large amounts of spatio-temporally resolved information.

Description

Many compression algorithms can be used to mitigate this problem, but since they are designed to compress generic scientific datasets, they do not account for the nature of climate model output and they compress only individual simulations.

In this work, we propose a different, statistics-based approach that explicitly accounts for the space-time dependence of the data for annual global three-dimensional temperature fields in an initial condition ensemble. The set of estimated parameters is small (compared to the data size) and can be regarded as a summary of the essential structure of the ensemble output; therefore, it can be used to instantaneously reproduce the temperature fields in an ensemble with a substantial saving in storage and time.

Read the rest (1 more)

The statistical model exploits the gridded geometry of the data and parallelization across processors. It is therefore computationally convenient and allows to fit a nontrivial model to a dataset of 1 billion data points with a covariance matrix comprising of 10 18 entries. Supplementary materials for this article are available online.

Links

Topics

Inferred from text
Climate model simulation 65%
Provenance · 1 source records, 12 field assertions
SourceKeyLast seenRaw
DataCite10.6084/m9.figshare.137893114 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · DataCiteconnector:datacite@1.0.0/data/attributes/rightsList
byte_sizesource · DataCiteconnector:datacite@1.0.0
concepts[field].fos:biological-sciencessource · DataCiteconnector:datacite@1.0.0
concepts[field].fos:computer-and-information-sciencessource · DataCiteconnector:datacite@1.0.0
concepts[field].fos:mathematicssource · DataCiteconnector:datacite@1.0.0
concepts[method].local:method:climate-modelenrichment · DataCitekeyword-concept-rules@1.0.0title+description (65%)
created_datesource · DataCiteconnector:datacite@1.0.0
descriptionsource · DataCiteconnector:datacite@1.0.0/data/attributes/descriptions
licensesource · DataCiteconnector:datacite@1.0.0/data/attributes/rightsList
publication_datesource · DataCiteconnector:datacite@1.0.0/data/attributes/dates
titlesource · DataCiteconnector:datacite@1.0.0/data/attributes/titles/0/title
updated_datesource · DataCiteconnector:datacite@1.0.0