Structure · dataset · 2026
Making Enterprise AI Explainable through Calibrated Confidence and Provenance
Listed in Loughborough Research Repository and GRANTS Data and UP Research Data Repository — shown once because both records carry DOI 10.6084/m9.figshare.34059414.v1
<p>Enterprise AI systems cannot earn stakeholder trust without genuine transparency: the ability to trace reasoning, communicate uncertainty accurately, and adapt explanations to user expertise.
Description
This paper presents a framework treating provenance tracking and uncertainty communication as foundational requirements. The framework maintains complete reasoning chains with explanation adaptation across four stakeholder levels.
Uncertainty decomposition separates epistemic from aleatoric components, enabling users to understand what actions might improve results. Confidence-based routing translates uncertainty into actionable decisions: validation bypass, mandatory review, or expert escalation. We evaluated the framework on 143 financial controlling queries.
Read the rest (3 more)
The first version was more confident on the predictions it got wrong than on the ones it got right, a gap of −2.42%. A confidence value like this misreports when a pattern choice is reliable, and a complete provenance record does not fix it on its own. Four improvement iterations raised pattern-selection accuracy from 68.53% to 84.62% (95% CI 77.7% to 89.8%) on that development set and moved the confidence gap to +17.93%.
The same queries drove those iterations, so we then ran the selector unchanged on an independent set of 200 queries. Accuracy there was 77.0% and the gap stayed positive at +12.2 pp, next to an expected calibration error of 0.182 and a Brier score of 0.190. These are the figures that say how the method generalizes.
A positive gap is one sign of calibration and not the whole of it, and every calibration figure reported here is for the pattern-selection confidence. The response confidence is future work.</p>
Links
Where it is published
- DOI doi.org/10.6084/m9.figshare.34059414.v1 ↗
DOI / persistent id · from repository lboro ac uk
Catalogue records · 1
- OAI-PMH record api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Af… ↗
metadata API · from repository lboro ac uk
Topics
- From keywords
- Biochemistry and cell biology · Biochemistry and cell biology · Biochemistry and cell biology · Cancer · Cancer · Cancer · Chemistry · Computer Science & AI · Earth & Environmental Science · Earth & Environmental Science · Earth & Environmental Science · Economics & Finance · Engineering · Engineering · Genetics · Genetics · Genetics · Humanities · Humanities · Life Sciences · Life Sciences · Life Sciences · Materials Science · Mathematics & Statistics · Medicine & Health · Medicine & Health · Medicine & Health · Psychology & Behavioral Science · Research, science and technology policy · Research, science and technology policy · Research, science and technology policy · Social Science · Social Science
Provenance · 3 source records, 38 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Loughborough Research Repository | oai:figshare.com:article/34059414 | 11 d ago | JSON v1 |
| GRANTS Data | oai:figshare.com:article/34059414 | 11 d ago | JSON v1 |
| UP Research Data Repository | oai:figshare.com:article/34059414 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[disease].local:disease:cancer | mapping · researchdata up ac za | vocabulary-mapper@1.0.0 | keywords['Cancer'] |
| concepts[disease].local:disease:cancer | mapping · grantsdata jst go jp | vocabulary-mapper@1.0.0 | keywords['Cancer'] |
| concepts[disease].local:disease:cancer | mapping · repository lboro ac uk | vocabulary-mapper@1.0.0 | keywords['Cancer'] |
| concepts[field].anzsrc:field:440710 | mapping · researchdata up ac za | vocabulary-mapper@1.0.0 | keywords['Science Policy'] |
| concepts[field].anzsrc:field:440710 | mapping · repository lboro ac uk | vocabulary-mapper@1.0.0 | keywords['Science Policy'] |
| concepts[field].anzsrc:field:440710 | mapping · grantsdata jst go jp | vocabulary-mapper@1.0.0 | keywords['Science Policy'] |
| concepts[field].anzsrc:group:3101 | mapping · grantsdata jst go jp | vocabulary-mapper@1.0.0 | keywords['Cell Biology'] |
| concepts[field].anzsrc:group:3101 | mapping · researchdata up ac za | vocabulary-mapper@1.0.0 | keywords['Cell Biology'] |
| concepts[field].anzsrc:group:3101 | mapping · repository lboro ac uk | vocabulary-mapper@1.0.0 | keywords['Cell Biology'] |
| concepts[field].anzsrc:group:3105 | mapping · repository lboro ac uk | vocabulary-mapper@1.0.0 | keywords['Genetics'] |
| concepts[field].anzsrc:group:3105 | mapping · grantsdata jst go jp | vocabulary-mapper@1.0.0 | keywords['Genetics'] |
| concepts[field].anzsrc:group:3105 | mapping · researchdata up ac za | vocabulary-mapper@1.0.0 | keywords['Genetics'] |
| concepts[field].local:field:chemistry | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:computer-science-ai | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · grantsdata jst go jp | connector:grantsdata_jst_go_jp@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:engineering | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:humanities | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · grantsdata jst go jp | connector:grantsdata_jst_go_jp@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:materials-science | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:mathematics-statistics | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · grantsdata jst go jp | connector:grantsdata_jst_go_jp@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:psychology-behavioral | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · researchdata up ac za | connector:researchdata_up_ac_za@1.0.0 | |
| concepts[field].local:field:social-science | mapping · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| description | source · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | /metadata/dc/description |
| license | source · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | /metadata/dc/rights |
| publication_date | source · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | |
| title | source · repository lboro ac uk | connector:repository_lboro_ac_uk@1.0.0 | /metadata/dc/title |