Hierarchical Sub-sentential Alignment with Anymalign

Adrien Lardilleux (1) , François Yvon (1) , Yves Lepage (2)

1 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
2 IPS - Graduate School of Information, Production and Systems

We present a sub-sentential alignment algorithm that relies on association scores between words or phrases. This algorithm is inspired by previous work on alignment by recursive binary segmentation and on document clustering. We evaluate the resulting alignments on machine translation tasks and show that we can obtain state-of-the-art results, with gains up to more than 4 BLEU points compared to previous work, with a method that is simple, independent of the size of the corpus to be aligned, and directly computes symmetric alignments. This work also provides new insights regarding the use of "heuristic" alignment scores in statistical machine translation.

Domaines: Traitement du texte et du document; Informatique et langage [cs.CL]

Adrien Lardilleux, François Yvon, Yves Lepage. Hierarchical Sub-sentential Alignment with Anymalign. 16th annual conference of the European Association for Machine Translation (EAMT 2012), May 2012, Trento, Italy. pp.279-286. ⟨hal-00747385⟩