Table · dataset · 2026
Model generalizability considerations in development and evaluation of SaMD
Listed in ZivaHub
<p>Software as a Medical Device (SaMD) has been transforming medical practices by improving patient care with more precise and timely information.
Description
Key capabilities of SaMD are often powered by Artificial Intelligence (AI) algorithms. However, significant challenges arise in developing robust algorithms for SaMD, as these algorithms can perform well during development but poorly during pivotal validation studies.
Due to the rapid advancement in medical research, data from new studies or real-world sources are likely to differ significantly from the legacy data used for development; with this, algorithms need to account for these potential data heterogeneity differences. This paper discusses the shortcomings of conventional cross-validation methods widely used in SaMD algorithm development and demonstrates model performance overestimation in the presence of data heterogeneity.
Read the rest (1 more)
To address this bias, we propose a simple and practical alternative: the leave-one-set-out (LOSO) cross-validation method. Additionally, we outline best practices for designing independent validation pivotal studies.</p>
Links
Where it is published
- DOI doi.org/10.6084/m9.figshare.34021512.v1 ↗
DOI / persistent id · from zivahub uct ac za
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from zivahub uct ac za
Topics
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ZivaHub | oai:figshare.com:article/34021512 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].anzsrc:group:3105 | mapping · zivahub uct ac za | vocabulary-mapper@1.0.0 | keywords['Genetics'] |
| concepts[field].anzsrc:group:3204 | mapping · zivahub uct ac za | vocabulary-mapper@1.0.0 | keywords['Immunology'] |
| concepts[field].local:field:astronomy | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:mathematics-statistics | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| description | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/description |
| license | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/rights |
| publication_date | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | |
| title | source · zivahub uct ac za | connector:zivahub_uct_ac_za@1.0.0 | /metadata/dc/title |