Data · dataset · 2026
AgenticGenomics: pharmacogenomics benchmark dataset for "Trustworthy agentic genomics through versioned skill libraries"
Listed in LSHTM Data Compass
AgenticGenomics benchmark dataset.
Description
Controlled three-arm comparison of nine frontier large language models on pharmacogenomic interpretation: Claude Opus 4, Claude Sonnet 4, GPT-5.2, GPT-4.1, o3, o4-mini, Gemini 2.5 Flash, DeepSeek V3 and Mistral Large 2, evaluated on 110 CPIC Level A cases across three population contexts (European, admixed Latin American, East African) under three conditions (free-prompted; retrieval-augmented from the CPIC guideline corpus; constrained by a versioned SKILL.md-format specification executed as a contract), three replicates per cell, 26,730 evaluations.
The archive contains raw model responses, baseline and clinical-equivalence rescorer outputs, the locked merged three-arm dataset (26,730 rows), the forward and reverse adversarial scrambled-specification experiments, the (gene, drug)-keyed chunking control, the drug-recommendation regression classification, and figure-input tables. Records are scored on phenotype identification (A1), drug recommendation (A2) and lethal-class safety action (A3).
Read the rest (1 more)
All data derive from public CPIC Level A guidelines and PharmGKB annotations; genotypes are synthetic canonical cases; no patient data and no new sequencing data are included. Analysis code: github.com/manuelcorpas/24-AGENTIC-PGX-BENCHMARK (commit dc2c849e). Companion to the Perspective "Agentic Genomics: From Pipeline Automation to Autonomous Validation".
Links
Where it is published
- DOI doi.org/10.5281/zenodo.20567742 ↗
DOI / persistent id · from lshtm ac uk
Catalogue records · 1
- OAI-PMH record datacompass.lshtm.ac.uk/cgi/oai2?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3… ↗
metadata API · from lshtm ac uk
Topics
- From keywords
- Earth & Environmental Science · Humanities · Life Sciences · Medicine & Health · Social Science
- Inferred from text
- Pharmacogenomics 81% · Sequencing 75%
Provenance · 1 source records, 10 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| LSHTM Data Compass | oai:datacompass.lshtm.ac.uk:5224 | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:321406 | enrichment · lshtm ac uk | taxonomy-embedding@1.0.0 | title+keywords+description (81%) |
| concepts[field].local:field:earth-environmental | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| concepts[modality].local:modality:sequencing | enrichment · lshtm ac uk | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | /metadata/dc/description |
| publication_date | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | |
| title | source · lshtm ac uk | connector:lshtm_ac_uk@1.0.0 | /metadata/dc/title |