← Search

Data · dataset · 2026

Parallel inference for massive distributed spatial data using low-rank models

Listed in National Center for Atmospheric Research

Due to rapid data growth, statistical analysis of massive datasets often has to be carried out in a distributed fashion, either because several datasets stored in separate physical locations are all relevant to a given problem, or simply to achieve faster (parallel) computation through a divide-and-conquer scheme.

Description

In both cases, the challenge is to obtain valid inference that does not require processing all data at a single central computing node.

We show that for a very widely used class of spatial low-rank models, which can be written as a linear combination of spatial basis functions plus a fine-scale-variation component, parallel spatial inference and prediction for massive distributed data can be carried out exactly, meaning that the results are the same as for a traditional, non-distributed analysis. The communication cost of our distributed algorithms does not depend on the number of data points.

Read the rest (1 more)

After extending our results to the spatio-temporal case, we illustrate our methodology by carrying out distributed spatio-temporal particle filtering inference on total precipitable water measured by three different satellite sensor systems.

Links

Get the data

Where it is published

Catalogue records · 1

Topics

Inferred from text
Geoinformatics 71%
Provenance · 1 source records, 8 field assertions
SourceKeyLast seenRaw
National Center for Atmospheric Research63d2ae04-7e6e-4c82-84fb-f3e92f14394613 d agoJSON v1
FieldAssertionExtractorEvidence
concepts[field].anzsrc:group:3704enrichment · data ucar edutaxonomy-embedding@1.1.0title+keywords+description (71%)
concepts[field].local:field:earth-environmentalmapping · data ucar educonnector:data_ucar_edu@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · data ucar educonnector:data_ucar_edu@1.0.0
created_datesource · data ucar educonnector:data_ucar_edu@1.0.0
descriptionsource · data ucar educonnector:data_ucar_edu@1.0.0/notes
publication_datesource · data ucar educonnector:data_ucar_edu@1.0.0
titlesource · data ucar educonnector:data_ucar_edu@1.0.0/title
updated_datesource · data ucar educonnector:data_ucar_edu@1.0.0