Data · dataset · 2026
Pragmatic Task Battery: LLM Responses and Rubric Scores
Listed in Teesside University Research Data Repository
This dataset accompanies the manuscript "Pragmalinguistic competence without sociopragmatic calibration: an exploratory assessment of pragmatic performance in four large language models," submitted to the Journal of Pragmatics.
Description
It contains the complete Pragmatic Task Battery (PTB) — twelve Discourse Completion Task (DCT) scenarios — the verbatim responses produced by four large language models (ChatGPT / GPT-5.3 Instant, Gemini 3 Flash, Claude Sonnet 4.6, and Perplexity Sonar Pro) to each scenario, and the Python script used to compute the statistical analysis reported in the manuscript (Friedman test, Kendall's W, post-hoc Wilcoxon signed-rank comparisons).
Links
Where it is published
- DOI doi.org/10.17632/sjwpr9ykb7.1 ↗
DOI / persistent id · from researchdata tees ac uk
Catalogue records · 1
- OAI-PMH record data.mendeley.com/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Adata… ↗
metadata API · from researchdata tees ac uk
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Engineering · Humanities · Life Sciences · Linguistics · Natural language processing · Social Science
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Teesside University Research Data Repository | oai:data.mendeley.com/sjwpr9ykb7.1 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].anzsrc:field:460208 | mapping · researchdata tees ac uk | vocabulary-mapper@1.0.0 | keywords['Natural Language Processing'] |
| concepts[field].anzsrc:group:4704 | mapping · researchdata tees ac uk | vocabulary-mapper@1.0.0 | keywords['Linguistics'] |
| concepts[field].local:field:computer-science-ai | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| description | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/description |
| license | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/rights |
| publication_date | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| title | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/title |