Table · dataset · 2026
Processed seismic survey data for validating DDPM
Listed in ZivaHub and Deakin Research Online and DMU Figshare and HKU DataHub and Swinburne Figshare and DaYta Ya Rona and SUNScholarData and figshare and Loughborough Research Repository and GRANTS Data and UP Research Data Repository — shown once because both records carry DOI 10.6084/m9.figshare.34041801.v1
<p dir="ltr">This record contains the processed inputs, model outputs, logs, and test products supporting Su, Agata, Fujie & Nakamura, "<i>Noise reduction for wide-angle OBS record sections with a denoising diffusion probabilistic model</i>" (JGR: Machine Learning and Computation, in revision).
Description
Version 2 adds the ensemble-averaged DDPM outputs, the leave-one-pass-out (LOPO) references and outputs, the self-similarity and baseline test products, the direct U-Net checkpoint, and the environment files requested during review.</p><p dir="ltr"><br></p><p dir="ltr">All waveform arrays are stored in .npz files written by the Profiles class and can be read and visualized with the code archived at DOI: 10.5281/zenodo.20922233 (source code, trained DDPM checkpoint model-final.pt, GPL-3.0).
An example of reading these files is given in the Jupyter notebook resultview_standalone.ipynb in that record. The raw SEG-Y survey data are distributed by the JAMSTEC Seismic Survey Database (DOI: 10.17596/0002069; cruise KH-24-JE03, line NT24, OBS 1–40, passes NT24-OBS1–5 and NT24-MCS1–2; cruise KR09-06, line A2, OBS 10).</p><h3 dir="ltr">Training logs and previews</h3><ul><li>converge.log — L1-L2 hybrid loss for the training set at every epoch (Fig. 2c).</li><li>validate.log — L1-L2 hybrid loss for the validation set, evaluated every 10 epochs (Fig. 2c).</li><li>result_images.tar — image previews of all 40 validation record sections (input, DDPM output, diversity-stacked reference).</li></ul><h3 dir="ltr">Single-run DDPM outputs (Figs. 1–7, Supplementary Figs.
Read the rest (2 more)
S1–S6)</h3><ul><li>result-test-move80-allshot.out.npz — 200-m validation set, 8 hold-out stations × 5 passes (40 sections). Index catalog below.</li><li>result-mcs-move80-allshot.out.npz — 50-m Noto test set (NT24-MCS), source-location-matched one-in-four shots, 40 stations.</li><li>result-nwp-move80-allshot.out.npz — NW Pacific test set (KR09-06, OBS 10), resampled to 250 Hz, traces 450–922.</li></ul><h3 dir="ltr">Ensemble-averaged DDPM outputs (Table 1 DDPM column, Supplementary Table S2)</h3><p dir="ltr">Reconstructions averaged over 20 independent ancestral samples, in the same Profiles format as the single-run files:</p><ul><li>ensemble.test.avgout.npz — scheme A (200-m validation).</li><li>ensemble.mcs.avgout.npz — scheme B (50-m Noto).</li><li>ensemble.nwp.avgout.npz — scheme C (NW Pacific).</li></ul><h3 dir="ltr">Repeated-sampling (self-similarity) test (Supplementary Section S3, Table S1)</h3><ul><li>self_similarity_test.tar.gz — the 20 per-run rebuild.out snapshots for the validation set, per-run metric tables (masked/unmasked RMS, hybrid loss, AIC and CC delays and misfit ratios), and the pairwise cosine-similarity reports (unmasked, direct-wave masked, masked + saturated at ±1 and ±0.3) as CSV/JSON.</li></ul><h3 dir="ltr">Baseline comparison (Table 1, Fig. 8, Supplementary Table S2)</h3><p><br></p><ul><li>baseline.tar.gz — rebuild outputs and metric tables for the direct U-Net and the trace-wise DeepDenoiser (pretrained model) on schemes A–C, together with the pooled (Table 1) and station-wise (Table S2) evaluation outputs.</li><li>unet-direct_model-final.pt — checkpoint of the deterministic direct U-Net baseline (same backbone as the DDPM, trained 200 epochs on the same prestack/diversity-stacked pairs).
Load with baseline/rebuild_unet_direct.py --checkpoint from the software record.</li></ul><h3 dir="ltr">Index catalog for the validation arrays</h3><p dir="ltr">Waveform array Profiles[n,:,:] (shot-station, time_sample, trace) in result-test-move80-allshot.out.npz and ensemble.test.avgout.npz:</p><table><tr><td><p dir="ltr">n=</p></td><td><p dir="ltr">NT24-OBS1</p></td><td><p dir="ltr">NT24-OBS2</p></td><td><p dir="ltr">NT24-OBS3</p></td><td><p dir="ltr">NT24-OBS4</p></td><td><p dir="ltr">NT24-OBS5</p></td></tr><tr><td><p dir="ltr">OBS 4</p></td><td><p>0</p></td><td><p>1</p></td><td><p>2</p></td><td><p>3</p></td><td><p>4</p></td></tr><tr><td><p dir="ltr">OBS 6</p></td><td><p>5</p></td><td><p>6</p></td><td><p>7</p></td><td><p>8</p></td><td><p>9</p></td></tr><tr><td><p dir="ltr">OBS 9</p></td><td><p>10</p></td><td><p>11</p></td><td><p>12</p></td><td><p>13</p></td><td><p>14</p></td></tr><tr><td><p dir="ltr">OBS 21</p></td><td><p>15</p></td><td><p>16</p></td><td><p>17</p></td><td><p>18</p></td><td><p>19</p></td></tr><tr><td><p dir="ltr">OBS 24</p></td><td><p>20</p></td><td><p>21</p></td><td><p>22</p></td><td><p>23</p></td><td><p>24</p></td></tr><tr><td><p dir="ltr">OBS 26</p></td><td><p>25</p></td><td><p>26</p></td><td><p>27</p></td><td><p>28</p></td><td><p>29</p></td></tr><tr><td><p dir="ltr">OBS 27</p></td><td><p>30</p></td><td><p>31</p></td><td><p>32</p></td><td><p>33</p></td><td><p>34</p></td></tr><tr><td><p dir="ltr">OBS 28</p></td><td><p>35</p></td><td><p>36</p></td><td><p>37</p></td><td><p>38</p></td><td><p>39</p></td></tr></table><p></p>
Links
Where it is published
- DOI doi.org/10.6084/m9.figshare.34041801.v1 ↗
DOI / persistent id · from zivahub uct ac za
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from zivahub uct ac za
Topics
- From keywords
- Astronomy & Astrophysics · Chemistry · Chemistry · Computer Science & AI · Computer Science & AI · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Economics & Finance · Economics & Finance · Engineering · Engineering · Engineering · Engineering · Humanities · Humanities · Humanities · Humanities · Life Sciences · Life Sciences · Life Sciences · Life Sciences · Materials Science · Mathematics & Statistics · Medicine & Health · Medicine & Health · Ocean & Atmospheric Science · Psychology & Behavioral Science · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Seismology and seismic exploration · Social Science · Social Science · Social Science · Social Science
Provenance · 11 source records, 58 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ZivaHub | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| Deakin Research Online | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| DMU Figshare | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| HKU DataHub | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| Swinburne Figshare | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| DaYta Ya Rona | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| SUNScholarData | oai:figshare.com:article/34041801 | 5 d ago | JSON v1 |
| figshare | oai:figshare.com:article/34041801 | 4 d ago | JSON v1 |
| Loughborough Research Repository | oai:figshare.com:article/34041801 | 4 d ago | JSON v1 |
| GRANTS Data | oai:figshare.com:article/34041801 | 4 d ago | JSON v1 |
| UP Research Data Repository | oai:figshare.com:article/34041801 | 4 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].anzsrc:field:370609 | mapping · figshare com | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · figshare dmu ac uk | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · repository lboro ac uk | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · datahub hku hk | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · figshare swinburne edu au | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · researchdata up ac za | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · dayta nwu ac za | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · zivahub uct ac za | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · scholardata sun ac za | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · dro deakin edu au | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].anzsrc:field:370609 | mapping · grantsdata jst go jp | vocabulary-mapper@1.0.0 | keywords['Seismology and seismic exploration'] |
| concepts[field].local:field:astronomy | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:chemistry | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:chemistry | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · dro deakin edu au | connector:dro_deakin_edu_au@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare dmu ac uk | connector:figshare_dmu_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · datahub hku hk | connector:datahub_hku_hk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare swinburne edu au | connector:figshare_swinburne_edu_au@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · dayta nwu ac za | connector:dayta_nwu_ac_za@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scholardata sun ac za | connector:scholardata_sun_ac_za@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · grantsdata jst go jp | connector:grantsdata_jst_go_jp@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:engineering | mapping · dayta nwu ac za | connector:dayta_nwu_ac_za@1.0.0 | |
| concepts[field].local:field:engineering | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:humanities | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:humanities | mapping · dayta nwu ac za | connector:dayta_nwu_ac_za@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · dayta nwu ac za | connector:dayta_nwu_ac_za@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:materials-science | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:mathematics-statistics | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:ocean-atmospheric | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[field].local:field:psychology-behavioral | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:social-science | mapping · dayta nwu ac za | connector:dayta_nwu_ac_za@1.0.0 | |
| concepts[field].local:field:social-science | mapping · figshare com | connector:figshare_com@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · zivahub uct ac za | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[modality].local:modality:tabular | enrichment · zivahub uct ac za | keyword-concept-rules@1.0.0 | title+description (65%) |
| description | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/description |
| license | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/rights |
| publication_date | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| title | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/title |