Constarium
← Search

Table · dataset · 2026

Processed seismic survey data for validating DDPM

Listed in ZivaHub and Deakin Research Online and DMU Figshare and HKU DataHub and Swinburne Figshare and DaYta Ya Rona and SUNScholarData and figshare and Loughborough Research Repository and GRANTS Data and UP Research Data Repository — shown once because both records carry DOI 10.6084/m9.figshare.34041801.v1

<p dir="ltr">This record contains the processed inputs, model outputs, logs, and test products supporting Su, Agata, Fujie & Nakamura, "<i>Noise reduction for wide-angle OBS record sections with a denoising diffusion probabilistic model</i>" (JGR: Machine Learning and Computation, in revision).

Description

Version 2 adds the ensemble-averaged DDPM outputs, the leave-one-pass-out (LOPO) references and outputs, the self-similarity and baseline test products, the direct U-Net checkpoint, and the environment files requested during review.</p><p dir="ltr"><br></p><p dir="ltr">All waveform arrays are stored in .npz files written by the Profiles class and can be read and visualized with the code archived at DOI: 10.5281/zenodo.20922233 (source code, trained DDPM checkpoint model-final.pt, GPL-3.0).

An example of reading these files is given in the Jupyter notebook resultview_standalone.ipynb in that record. The raw SEG-Y survey data are distributed by the JAMSTEC Seismic Survey Database (DOI: 10.17596/0002069; cruise KH-24-JE03, line NT24, OBS 1–40, passes NT24-OBS1–5 and NT24-MCS1–2; cruise KR09-06, line A2, OBS 10).</p><h3 dir="ltr">Training logs and previews</h3><ul><li>converge.log — L1-L2 hybrid loss for the training set at every epoch (Fig. 2c).</li><li>validate.log — L1-L2 hybrid loss for the validation set, evaluated every 10 epochs (Fig. 2c).</li><li>result_images.tar — image previews of all 40 validation record sections (input, DDPM output, diversity-stacked reference).</li></ul><h3 dir="ltr">Single-run DDPM outputs (Figs. 1–7, Supplementary Figs.

Read the rest (2 more)

S1–S6)</h3><ul><li>result-test-move80-allshot.out.npz — 200-m validation set, 8 hold-out stations × 5 passes (40 sections). Index catalog below.</li><li>result-mcs-move80-allshot.out.npz — 50-m Noto test set (NT24-MCS), source-location-matched one-in-four shots, 40 stations.</li><li>result-nwp-move80-allshot.out.npz — NW Pacific test set (KR09-06, OBS 10), resampled to 250 Hz, traces 450–922.</li></ul><h3 dir="ltr">Ensemble-averaged DDPM outputs (Table 1 DDPM column, Supplementary Table S2)</h3><p dir="ltr">Reconstructions averaged over 20 independent ancestral samples, in the same Profiles format as the single-run files:</p><ul><li>ensemble.test.avgout.npz — scheme A (200-m validation).</li><li>ensemble.mcs.avgout.npz — scheme B (50-m Noto).</li><li>ensemble.nwp.avgout.npz — scheme C (NW Pacific).</li></ul><h3 dir="ltr">Repeated-sampling (self-similarity) test (Supplementary Section S3, Table S1)</h3><ul><li>self_similarity_test.tar.gz — the 20 per-run rebuild.out snapshots for the validation set, per-run metric tables (masked/unmasked RMS, hybrid loss, AIC and CC delays and misfit ratios), and the pairwise cosine-similarity reports (unmasked, direct-wave masked, masked + saturated at ±1 and ±0.3) as CSV/JSON.</li></ul><h3 dir="ltr">Baseline comparison (Table 1, Fig. 8, Supplementary Table S2)</h3><p><br></p><ul><li>baseline.tar.gz — rebuild outputs and metric tables for the direct U-Net and the trace-wise DeepDenoiser (pretrained model) on schemes A–C, together with the pooled (Table 1) and station-wise (Table S2) evaluation outputs.</li><li>unet-direct_model-final.pt — checkpoint of the deterministic direct U-Net baseline (same backbone as the DDPM, trained 200 epochs on the same prestack/diversity-stacked pairs).

Load with baseline/rebuild_unet_direct.py --checkpoint from the software record.</li></ul><h3 dir="ltr">Index catalog for the validation arrays</h3><p dir="ltr">Waveform array Profiles[n,:,:] (shot-station, time_sample, trace) in result-test-move80-allshot.out.npz and ensemble.test.avgout.npz:</p><table><tr><td><p dir="ltr">n=</p></td><td><p dir="ltr">NT24-OBS1</p></td><td><p dir="ltr">NT24-OBS2</p></td><td><p dir="ltr">NT24-OBS3</p></td><td><p dir="ltr">NT24-OBS4</p></td><td><p dir="ltr">NT24-OBS5</p></td></tr><tr><td><p dir="ltr">OBS 4</p></td><td><p>0</p></td><td><p>1</p></td><td><p>2</p></td><td><p>3</p></td><td><p>4</p></td></tr><tr><td><p dir="ltr">OBS 6</p></td><td><p>5</p></td><td><p>6</p></td><td><p>7</p></td><td><p>8</p></td><td><p>9</p></td></tr><tr><td><p dir="ltr">OBS 9</p></td><td><p>10</p></td><td><p>11</p></td><td><p>12</p></td><td><p>13</p></td><td><p>14</p></td></tr><tr><td><p dir="ltr">OBS 21</p></td><td><p>15</p></td><td><p>16</p></td><td><p>17</p></td><td><p>18</p></td><td><p>19</p></td></tr><tr><td><p dir="ltr">OBS 24</p></td><td><p>20</p></td><td><p>21</p></td><td><p>22</p></td><td><p>23</p></td><td><p>24</p></td></tr><tr><td><p dir="ltr">OBS 26</p></td><td><p>25</p></td><td><p>26</p></td><td><p>27</p></td><td><p>28</p></td><td><p>29</p></td></tr><tr><td><p dir="ltr">OBS 27</p></td><td><p>30</p></td><td><p>31</p></td><td><p>32</p></td><td><p>33</p></td><td><p>34</p></td></tr><tr><td><p dir="ltr">OBS 28</p></td><td><p>35</p></td><td><p>36</p></td><td><p>37</p></td><td><p>38</p></td><td><p>39</p></td></tr></table><p></p>

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Image 75% · Tabular 65%
Provenance · 11 source records, 58 field assertions
SourceKeyLast seenRaw
ZivaHuboai:figshare.com:article/340418015 d agoJSON v1
Deakin Research Onlineoai:figshare.com:article/340418015 d agoJSON v1
DMU Figshareoai:figshare.com:article/340418015 d agoJSON v1
HKU DataHuboai:figshare.com:article/340418015 d agoJSON v1
Swinburne Figshareoai:figshare.com:article/340418015 d agoJSON v1
DaYta Ya Ronaoai:figshare.com:article/340418015 d agoJSON v1
SUNScholarDataoai:figshare.com:article/340418015 d agoJSON v1
figshareoai:figshare.com:article/340418014 d agoJSON v1
Loughborough Research Repositoryoai:figshare.com:article/340418014 d agoJSON v1
GRANTS Dataoai:figshare.com:article/340418014 d agoJSON v1
UP Research Data Repositoryoai:figshare.com:article/340418014 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].anzsrc:field:370609mapping · figshare comvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · figshare dmu ac ukvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · datahub hku hkvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · figshare swinburne edu auvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · researchdata up ac zavocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · dayta nwu ac zavocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · zivahub uct ac zavocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · scholardata sun ac zavocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · dro deakin edu auvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].anzsrc:field:370609mapping · grantsdata jst go jpvocabulary-mapper@1.0.0keywords['Seismology and seismic exploration']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · dro deakin edu auconnector:dro_deakin_edu_au@1.0.0
concepts[field].local:field:earth-environmentalmapping · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare dmu ac ukconnector:figshare_dmu_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · datahub hku hkconnector:datahub_hku_hk@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare swinburne edu auconnector:figshare_swinburne_edu_au@1.0.0
concepts[field].local:field:earth-environmentalmapping · dayta nwu ac zaconnector:dayta_nwu_ac_za@1.0.0
concepts[field].local:field:earth-environmentalmapping · scholardata sun ac zaconnector:scholardata_sun_ac_za@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:earth-environmentalmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · grantsdata jst go jpconnector:grantsdata_jst_go_jp@1.0.0
concepts[field].local:field:earth-environmentalmapping · researchdata up ac zaconnector:researchdata_up_ac_za@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · dayta nwu ac zaconnector:dayta_nwu_ac_za@1.0.0
concepts[field].local:field:engineeringmapping · researchdata up ac zaconnector:researchdata_up_ac_za@1.0.0
concepts[field].local:field:humanitiesmapping · researchdata up ac zaconnector:researchdata_up_ac_za@1.0.0
concepts[field].local:field:humanitiesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · dayta nwu ac zaconnector:dayta_nwu_ac_za@1.0.0
concepts[field].local:field:life-sciencesmapping · dayta nwu ac zaconnector:dayta_nwu_ac_za@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · researchdata up ac zaconnector:researchdata_up_ac_za@1.0.0
concepts[field].local:field:life-sciencesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:materials-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:medicine-healthmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:psychology-behavioralmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · researchdata up ac zaconnector:researchdata_up_ac_za@1.0.0
concepts[field].local:field:social-sciencemapping · dayta nwu ac zaconnector:dayta_nwu_ac_za@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
concepts[modality].local:modality:imageenrichment · zivahub uct ac zakeyword-concept-rules@1.0.0title+description (75%)
concepts[modality].local:modality:tabularenrichment · zivahub uct ac zakeyword-concept-rules@1.0.0title+description (65%)
descriptionsource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/description
licensesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/rights
publication_datesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0
titlesource · zivahub uct ac zaconnector:zivahub_uct_ac_za@1.0.0/metadata/dc/title