Skip to Main content Skip to Navigation
Journal articles

A comparison of discriminative training criteria for continuous space translation models

Abstract : This paper explores a new discriminative training procedure for continuous-space translation models (CTMs) which correlates better with translation quality than conventional training methods. The core of the method lays in the definition of a novel objective function which enables us to effectively integrate the CTM with the rest of the translation system through N-best rescoring. Using a fixed architecture, where we iteratively retrain the CTM parameters and the log-linear coefficients, we compare various ways to define and combine training criteria for each of these steps, drawing inspirations both from max-margin and learning-to-rank techniques. We experimentally show that a recently introduced loss function, which combines these two techniques, outperforms several objective functions from the literature. We also show that ensuring the consistency of the losses used to train these two sets of parameters is beneficial to the overall performance.
Complete list of metadatas

Cited literature [57 references]  Display  Hide  Download
Contributor : Limsi Publications <>
Submitted on : Tuesday, October 30, 2018 - 9:29:51 AM
Last modification on : Monday, February 10, 2020 - 6:14:08 PM
Document(s) archivé(s) le : Thursday, January 31, 2019 - 1:09:36 PM


Files produced by the author(s)


  • HAL Id : hal-01621763, version 1


Alexandre Allauzen, Quoc Khanh Do, François Yvon. A comparison of discriminative training criteria for continuous space translation models. Machine Translation, Springer Verlag, 2017, 1-2, 31, pp.19-33. ⟨hal-01621763⟩



Record views


Files downloads