Skip to Main content Skip to Navigation
Conference papers

PROPRE: PROjection and PREdiction for multimodal correlations learning. An application to pedestrians visual data discrimination

Mathieu Lefort 1, 2 Alexander Gepperth 1, 2
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : PROPRE is a generic and modular unsupervised neural learning paradigm that extracts meaningful concepts of multimodal data flows based on predictability across modalities. It consists on the combination of three modules. First, a topological projection of each data flow on a self-organizing map. Second, a decentralized prediction of each projection activity from each others map activities. Third, a predictability measure that compares predicted and real activities. This measure is used to modulate the projection learning so that to favor the mapping of predictable stimuli across modalities. In this article, we use Kohonen map for the projection module, linear regression for the prediction one and we propose multiple generic predictability measures. We illustrate the properties and performances of PROPRE paradigm on a challenging supervised classification task of visual pedestrian data. The modulation of the projection learning by the predictability measure improves significantly classification performances of the system independently of the measure used. Moreover, PROPRE provides a combination of interesting functional properties, such as a dynamical adaptation to input statistic variations, that is rarely available in other machine learning algorithms.
Complete list of metadata

Cited literature [25 references]  Display  Hide  Download
Contributor : Mathieu Lefort Connect in order to contact the contributor
Submitted on : Monday, September 8, 2014 - 10:54:38 AM
Last modification on : Thursday, December 16, 2021 - 6:46:03 PM
Long-term archiving on: : Tuesday, December 9, 2014 - 11:45:53 AM


Files produced by the author(s)


  • HAL Id : hal-01061662, version 1



Mathieu Lefort, Alexander Gepperth. PROPRE: PROjection and PREdiction for multimodal correlations learning. An application to pedestrians visual data discrimination. IJCNN - International Joint Conference on Neural Networks, Jul 2014, Pékin, China. ⟨hal-01061662⟩



Les métriques sont temporairement indisponibles