Data · dataset · 2026
BLEU Score Dataset of Chinese-English Financial News Translation by 3 Domestic Large Language Models (Reasoning & Non-Reasoning Dual Modes, Context Isolation Environment)
Listed in ScienceDB
Description
This dataset is the supporting experimental measured data of the undergraduate thesis A BLEU-Based Quantitative Comparison of AI Translation Tools for Chinese-English Financial News Texts, with the core being the quantitative evaluation results of Chinese-English financial news translation quality by large language models (LLMs).In this study, 50 authoritative Chinese-English parallel financial news sentences published by China Daily in 2025 were taken as translation samples, and three mainstream domestic LLMs in China, namely Doubao, DeepSeek and Yuanbao, were selected as the research objects.
In a strictly context-isolated experimental environment (dialogue memory function disabled, independent dialogue for each sample to eliminate contextual interference), the English translations of the models under Reasoning Mode and Non-Reasoning Mode were obtained respectively. With the internationally accepted BLEU (Bilingual Evaluation Understudy) as the core indicator, the translation quality score corresponding to each translation was calculated.This dataset includes the full original BLEU score data of 50 samples from 6 experimental groups (3 models × 2 generation modes), as well as the corresponding descriptive statistical results including mean, standard deviation, 95% confidence interval, variance and coefficient of variation.
Read the rest (1 more)
It can be used for academic research on AI professional translation quality evaluation, performance comparison of LLM generation modes, and construction of machine translation evaluation systems.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.33488 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Economics & Finance · Engineering · Humanities · Life Sciences · Social Science
- Inferred from text
- Artificial intelligence 72%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.33488 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:group:4602 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (72%) |
| concepts[field].local:field:computer-science-ai | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:economics-finance | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |