Inducing Multilingual Text Analysis Tools Using Bidirectional Recurrent Neural Networks

Othman Zennaki (1, 2) , Nasredine Semmar (1) , Laurent Besacier (3, 2, 4)

1 LIST (CEA) - Laboratoire d'Intégration des Systèmes et des Technologies
2 GETALP - Groupe d’Étude en Traduction Automatique/Traitement Automatisé des Langues et de la Parole
3 LIG - Laboratoire d'Informatique de Grenoble
4 IUF - Institut universitaire de France

This work focuses on the rapid development of linguistic annotation tools for resource-poor languages. We experiment several cross-lingual annotation projection methods using Recurrent Neural Networks (RNN) models. The distinctive feature of our approach is that our multilingual word representation requires only a parallel corpus between the source and target language. More precisely, our method has the following characteristics: (a) it does not use word alignment information, (b) it does not assume any knowledge about foreign languages, which makes it applicable to a wide range of resource-poor languages, (c) it provides truly multilingual taggers. We investigate both uni-and bi-directional RNN models and propose a method to include external information (for instance low level information from POS) in the RNN to train higher level taggers (for instance, super sense taggers). We demonstrate the validity and genericity of our model by using parallel corpora (obtained by manual or automatic translation). Our experiments are conducted to induce cross-lingual POS and super sense taggers.

Mots clés: crosslingual annotation projection; Supersense tagging; POS tagging; RNN

Domaines: Informatique et langage [cs.CL]

Othman Zennaki, Nasredine Semmar, Laurent Besacier. Inducing Multilingual Text Analysis Tools Using Bidirectional Recurrent Neural Networks. COLING 2016, ANLP, Dec 2016, Osaka, Japan. ⟨hal-01374205⟩