← Search

Data · dataset · 2026

BLEU Score Dataset of Chinese-English Financial News Translation by 3 Domestic Large Language Models (Reasoning & Non-Reasoning Dual Modes, Context Isolation Environment)

Listed in ScienceDB

Description

This dataset is the supporting experimental measured data of the undergraduate thesis A BLEU-Based Quantitative Comparison of AI Translation Tools for Chinese-English Financial News Texts, with the core being the quantitative evaluation results of Chinese-English financial news translation quality by large language models (LLMs).In this study, 50 authoritative Chinese-English parallel financial news sentences published by China Daily in 2025 were taken as translation samples, and three mainstream domestic LLMs in China, namely Doubao, DeepSeek and Yuanbao, were selected as the research objects.

In a strictly context-isolated experimental environment (dialogue memory function disabled, independent dialogue for each sample to eliminate contextual interference), the English translations of the models under Reasoning Mode and Non-Reasoning Mode were obtained respectively. With the internationally accepted BLEU (Bilingual Evaluation Understudy) as the core indicator, the translation quality score corresponding to each translation was calculated.This dataset includes the full original BLEU score data of 50 samples from 6 experimental groups (3 models × 2 generation modes), as well as the corresponding descriptive statistical results including mean, standard deviation, 95% confidence interval, variance and coefficient of variation.

Read the rest (1 more)

It can be used for academic research on AI professional translation quality evaluation, performance comparison of LLM generation modes, and construction of machine translation evaluation systems.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Artificial intelligence 72%
Provenance · 1 source records, 13 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.3348811 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].anzsrc:group:4602enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (72%)
concepts[field].local:field:computer-science-aimapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:economics-financemapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
licensesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/rights
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title