A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French

Xavier Hinaut (1) , Johannes Twiefel (1) , Maxime Petit (2) , Peter Dominey (2) , Stefan Wermter (1)

1 KT - Knowledge Technology group [Hamburg]
2 SBRI - Institut cellule souche et cerveau

How humans acquire language, and in particular two or more different languages with the same neural computing substrate, is still an open issue. To address this issue we suggest to build models that are able to process any language from the very beginning. Here we propose a developmental and neuro-inspired approach that processes sentences word by word with no prior knowledge of the semantics of the words. Our model has no "pre-wired" structure but only random and learned connections: it is based on Reservoir Computing. Our previous model has been implemented in the context of robotic platforms where users could teach basics of the English language to instruct a robot to perform actions. In this paper, we add the ability to process infrequent words, so we could keep our vocabulary size very small while processing natural language sentences. Moreover, we extend this approach to the French language and demonstrate that the network can learn both languages at the same time. Even with small corpora the model is able to learn and generalize in monolingual and bilingual conditions. This approach promises to be a more practical alternative for small corpora of different languages than other supervised learning methods relying on big data sets or more hand-crafted parsers requiring more manual encoding effort.

Domains: Neural and Evolutionary Computing [cs.NE]; Machine Learning [cs.LG]; Robotics [cs.RO]; Neurons and Cognition [q-bio.NC]; Linguistics

Xavier Hinaut, Johannes Twiefel, Maxime Petit, Peter Dominey, Stefan Wermter. A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French. Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015), Dec 2015, Montreal, Canada. ⟨hal-02561258⟩