Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Two studies on multilingual multimodal image description provide empirical evidence towards two questions at the core of the task: (i) whether target language speakers prefer descriptions generated directly in their native language, as compared to descriptions translated from a different language; (ii) whether images improve human translation of descriptions. These results provide guidance for future work in multimodal natural language processing by first showing that on the whole, translations are not distinguished from native language descriptions, and second delineating and quantifying the information gained from the image during the human translation task.
OriginalsprogEngelsk
TidsskriftNatural Language Engineering
Vol/bind24
Udgave nummer3
Sider (fra-til)393-413
Antal sider21
ISSN1351-3249
DOI
StatusUdgivet - 2018

ID: 230797269