Skip to Main content Skip to Navigation
Conference papers

The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Abstract : Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by \citet{burlot-yvon-wmt2017} for the English-to-Czech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018's participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01910244
Contributor : Limsi Publications <>
Submitted on : Sunday, December 2, 2018 - 8:37:02 PM
Last modification on : Monday, February 10, 2020 - 6:14:12 PM
Document(s) archivé(s) le : Sunday, March 3, 2019 - 12:12:45 PM

File

WMT060.pdf
Publisher files allowed on an open archive

Identifiers

Citation

Franck Burlot, Yves Scherrer, Vinit Ravishankar, Ondřej Bojar, Stig-Arne Grönroos, et al.. The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English. 3rd Conference on Machine Translation (WMT 18), Oct 2018, Bruxelles, Belgium. pp.550-564, ⟨10.18653/v1/W18-64060⟩. ⟨hal-01910244⟩

Share

Metrics

Record views

78

Files downloads

117