Skip to Main content Skip to Navigation
Conference papers

METEOR For Multiple Target Languages Using DBnary

Abstract : This paper proposes an extension of METEOR, a well-known MT evaluation metric, for multiple target languages using an in-house lexical resource called DBnary (an extraction from Wiktionary provided to the community as a Multilingual Lexical Linked Open Data). Today, the use of the synonymy module of METEOR is only exploited when English is the target language (use of WordNet). A synonymy module using DBnary would allow its use for the 21 languages (covered up to now) as target languages. The code of this new instance of METEOR, adapted to several target languages, is provided to the community via a github repository. We also show that our DBnary augmented METEOR increases the correlation with human judgements on the WMT 2013 and 2014 metrics dataset for English-to-(French, Russian, German, Spanish) language pairs.
Document type :
Conference papers
Complete list of metadatas
Contributor : Laurent Besacier <>
Submitted on : Sunday, August 21, 2016 - 9:08:51 AM
Last modification on : Friday, July 17, 2020 - 11:10:26 AM
Long-term archiving on: : Tuesday, November 22, 2016 - 10:13:08 AM


Publisher files allowed on an open archive


  • HAL Id : hal-01350109, version 1


Zied Elloumi, Hervé Blanchon, Gilles Serasset, Laurent Besacier. METEOR For Multiple Target Languages Using DBnary. MT Summit 2015, Nov 2015, Miami, United States. ⟨hal-01350109⟩



Record views


Files downloads