Learning Deep Neural Networks for High Dimensional Output Problems

Benjamin Labbé (1) , Romain Hérault (1) , Clement Chatelain (1)

1 LITIS - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes

State-of-the-art pattern recognition methods have difficulty dealing with problems where the dimension of the output space is large. In this article, we propose a new framework based on deep architectures (e.g. Deep Neural Networks) in order to deal with this issue. Deep architectures have proven to be efficient for high dimensional input problems such as image classification, due to their ability to embed the input space. The main contribution of this article is the extension of the embedding procedure to both the input and output spaces in order to easily handle high dimensional output problems. Using this extension, inter-output dependencies can be modelled efficiently. This provides an interesting alternative to probabilistic models such as HMM and CRF. Preliminary experiments on tay datasets and USPS character reconstruction show promising results.

Domaines: Traitement du texte et du document

Benjamin Labbé, Romain Hérault, Clement Chatelain. Learning Deep Neural Networks for High Dimensional Output Problems. ICMLA, Dec 2009, United States. 6p. ⟨hal-00438714⟩