Data · dataset · 2026
Parallel inference for massive distributed spatial data using low-rank models
Listed in National Center for Atmospheric Research
Due to rapid data growth, statistical analysis of massive datasets often has to be carried out in a distributed fashion, either because several datasets stored in separate physical locations are all relevant to a given problem, or simply to achieve faster (parallel) computation through a divide-and-conquer scheme.
Description
In both cases, the challenge is to obtain valid inference that does not require processing all data at a single central computing node.
We show that for a very widely used class of spatial low-rank models, which can be written as a linear combination of spatial basis functions plus a fine-scale-variation component, parallel spatial inference and prediction for massive distributed data can be carried out exactly, meaning that the results are the same as for a traditional, non-distributed analysis. The communication cost of our distributed algorithms does not depend on the number of data points.
Read the rest (1 more)
After extending our results to the spatio-temporal case, we illustrate our methodology by carrying out distributed spatio-temporal particle filtering inference on total precipitable water measured by three different satellite sensor systems.
Links
Get the data
- Publisher page n2t.org/ark:/85065/d79z96pf ↗
documentation · download · from data ucar edu
Where it is published
- data.ucar.edu /dataset/parallel-inference-for-massive-distributed-spatial-dat… ↗
National Center for Atmospheric Research dataset page
landing page · from data ucar edu
Catalogue records · 1
- CKAN API data.ucar.edu/api/3/action/package_show?id=63d2ae04-7e6e-4c82-84fb-f3e92f143… ↗
metadata API · from data ucar edu
Topics
- From keywords
- Earth & Environmental Science · Ocean & Atmospheric Science
- Inferred from text
- Geoinformatics 71%
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| National Center for Atmospheric Research | 63d2ae04-7e6e-4c82-84fb-f3e92f143946 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:group:3704 | enrichment · data ucar edu | taxonomy-embedding@1.1.0 | title+keywords+description (71%) |
| concepts[field].local:field:earth-environmental | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| created_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| description | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /notes |
| publication_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 | |
| title | source · data ucar edu | connector:data_ucar_edu@1.0.0 | /title |
| updated_date | source · data ucar edu | connector:data_ucar_edu@1.0.0 |