Data · dataset · 2024
Replication Data for: Realizing Joint Extreme-Scale Simulations on Multiple Supercomputers - Two Superfacility Case Studies
Listed in DaRUS
This data repository contains input and output files for large-scale experiments conducted on the three German national supercomputers HAWK, SuperMUC-NG, and JUWELS.
Description
More structure can be seen when switching to "Tree" view below. Then, the files are structured into three folders (`io-benchmark`, `two-systems, `three-systems`), and the outputs were generated with the following software versions: IO-Benchmark: DisCoTec version e8fad8ae, inputs and outputs both compressed into the same file.
Includes file preparation scripts and darshan outputs. The darshan files are also uploaded to hpcioanalysis.zdv.uni-mainz.de/traces (search `DisCoTec` in "Application" or `HAWK` in "Cluster), where they can be explored interactively. Two-system experiment: DisCoTec version e81a10589, UFTP copy scripts (in the DisCoTec repository) version 125ce10a5.
Read the rest (3 more)
Three-system experiment: DisCoTec version 46127fe94c1, UFTP copy scripts (in the DisCoTec repository) version 58d1b9ba9. The input files were generated with github.com/SGpp/DisCoTec-combischeme-utilities version 88d11fb0, exact commands can be seen from the scrips in this repository. After the combination scheme is assigned to systems, the conjoint file sizes need to be generated as detailed in github.com/SGpp/DisCoTec/blob/main/tools/subspace_writer/README.md .
The resulting `scheme*json` and `*conjoint.sizes` files are part of the input generator folders uploaded here. The measurements for the I/O benchmark were taken on October 6 2023. The measurements for the two-system setup were taken on September 4 2023 between 14:30 and 15:30.
The measurements for the three-system setup were taken on November 8 2023 between 13:30 and 15:00. Raw data are uploaded as .tar.gz files in the respective folder.
Links
Where it is published
- Dataverse dataset page darus.uni-stuttgart.de/dataset.xhtml?persistentId=doi%3A10.18419%2FDARUS-3707 ↗
landing page · from darus uni stuttgart de
- DOI doi.org/10.18419/darus-3707 ↗
DOI / persistent id · from darus uni stuttgart de
Catalogue records · 1
- Dataverse API darus.uni-stuttgart.de/api/datasets/:persistentId/?persistentId=doi%3A10.18419%2FDARU… ↗
metadata API · from darus uni stuttgart de
Topics
- Stated by source
- Computer and Information Science · Physics
- From keywords
- Physics
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| DaRUS | doi:10.18419/DARUS-3707 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].dataverse_subject:computer-and-information-science | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | /subjects |
| concepts[field].dataverse_subject:physics | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | /subjects |
| concepts[field].local:field:physics | mapping · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | /subjects |
| created_date | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | |
| description | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | /description |
| publication_date | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | |
| title | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | /name |
| updated_date | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 | |
| version_label | source · darus uni stuttgart de | connector:darus_uni_stuttgart_de@1.0.0 |