Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Robust Active Binocular Vision through Intrinsically Motivated Learning

Abstract : The efficient coding hypothesis posits that sensory systems of animals strive to encode sensory signals efficiently by taking into account the redundancies in them. This principle has been very successful in explaining response properties of visual sensory neurons as adaptations to the statistics of natural images. Recently, we have begun to extend the efficient coding hypothesis to active perception through a form of intrinsically motivated learning: a sensory model learns an efficient code for the sensory signals while a reinforcement learner generates movements of the sense organs to improve the encoding of the signals. To this end, it receives an intrinsically generated reinforcement signal indicating how well the sensory model encodes the data. This approach has been tested in the context of binocular vison, leading to the autonomous development of disparity tuning and vergence control. Here we systematically investigate the robustness of the new approach in the context of a binocular vision system implemented on a robot. Robustness is an important aspect that reflects the ability of the system to deal with unmodeled disturbances or events, such as insults to the system that displace the stereo cameras. To demonstrate the robustness of our method and its ability to self-calibrate, we introduce various perturbations and test if and how the system recovers from them. We find that (1) the system can fully recover from a perturbation that can be compensated through the system's motor degrees of freedom, (2) performance degrades gracefully if the system cannot use its motor degrees of freedom to compensate for the perturbation, and (3) recovery from a perturbation is improved if both the sensory encoding and the behavior policy can adapt to the perturbation. Overall, this work demonstrates that our intrinsically motivated learning approach for efficient coding in active perception gives rise to a self-calibrating perceptual system of high robustness.
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Céline Teulière Connect in order to contact the contributor
Submitted on : Friday, May 16, 2014 - 6:21:26 PM
Last modification on : Monday, March 21, 2016 - 5:38:33 PM
Long-term archiving on: : Saturday, August 16, 2014 - 12:21:26 PM


Publisher files allowed on an open archive




Luca Lonini, Sébastien Forestier, Céline Teulière, yu Zhao, Bertram E. Shi, et al.. Robust Active Binocular Vision through Intrinsically Motivated Learning. Frontiers in Neurorobotics, Frontiers, 2013, 7 (20), ⟨10.3389/fnbot.2013.00020⟩. ⟨hal-00992351⟩



Record views


Files downloads