Uncertainty-Aware Adaptation for Simultaneous Machine Translation under Domain Shift

Author/creator Sarambo, Stephanie Elizabeth author
Other author Herndon, Nic degree supervisor.
Other author East Carolina University
Format Theses and dissertations
Publication[Greenville, N.C.] : [East Carolina University 2026.]
Description66 pages
Supplemental ContentAccess via ScholarShip

Summary Simultaneous Machine Translation (SiMT) uses advancements in Natural Language Processing (NLP) to provide seamless, real-time communication between languages, while balancing translation quality and latency. However, these systems are highly sensitive to domain shift, where discrepancies between training and deployment data can significantly degrade performance. This paper proposes an uncertainty-aware SiMT framework that detects and adapts to domain shift in real-time. The system uses a neural machine translation model called StreamSpeech integrated with an uncertainty module that computes token-level entropy from the model distribution, then uses an adaptation policy to improve translation quality. The model is trained and evaluated on general-domain speech datasets commonly used in large-scale speech translation research, and its robustness is assessed using an out-of-domain dataset to induce controlled domain shift. The datasets used in this paper are the general-domain datasets CoVoST2 and Microsoft Speech Language Translation (MSLT), and the medical domain dataset Multilingual Medical Speech Translation (MultiMed-ST). Uncertainty behavior is analyzed by logging entropy values during streaming translation and examining the correlation between uncertainty spikes and translation errors. System performance is analyzed using BLEU scores for translation quality, and Average Lagging (AL) for latency.Finally, the proposed framework introduces an uncertainty-triggered adaptive waiting strategy that dynamically increases translation delay only when uncertainty falls within a predefined threshold. Experimentation results suggest that not only does uncertainty-aware adaptive waiting improve translation quality under domain-shift, but it also improves translation quality in the general-domain, while maintaining low latency, offering a practical approach to enhancing robustness in simultaneous translation systems.
Dissertation noteEast Carolina University 2026.
Bibliography noteIncludes bibliographical references.
Technical detailsSystem requirements: Adobe Reader.
Technical detailsMode of access: World Wide Web.

Availability

Library Location Call Number Status Item Actions
Electronic Resources Access Content Online ✔ Available