How Can a Robot Evaluate its own Behavior ? A Neural Model for Self-Assessment

Adrien Jauffret (1) , Caroline Grand (1) , Nicolas Cuperlier (1) , Philippe Gaussier (1) , Philippe Tarroux (2)

1 ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur

Allowing a robot to autonomously navigate wide and unknown environments not only requires a set of robust strategies to cope with miscellaneous situations, but also needs mechanisms of self-assessment for guiding learning and monitoring strategies. Monitoring strategies requires feedbacks on the behavior's quality, from a given fitness system, to take correct decisions. In this work, we focus on how violations of expectations of such fitness system can be detected. Following an incremental and bio-mimetic approach, we first present two different sensorimotor strategies our robot can use to navigate: a Place Cells based strategy and a road following strategy. Then, we present a neural architecture that may be able to evaluate both navigation strategies. This model is based on an online novelty detection algorithm using a neural predictor. This neural predictor learns contingencies between sensations and actions, giving the expected sensation based from the previous perception. Prediction error, coming from surprising events, provides a direct measure of the quality of the underlying sensorimotor contingencies involved. We propose that this model might be a key structure toward self-assessment. We made several experiments that can account for such properties for both strategies.

Domaines: Robotique [cs.RO]

Adrien Jauffret, Caroline Grand, Nicolas Cuperlier, Philippe Gaussier, Philippe Tarroux. How Can a Robot Evaluate its own Behavior ? A Neural Model for Self-Assessment. International Joint Conference on Neural Networks 2013, Jun 2013, Dallas, United States. pp.534-541. ⟨hal-00828374⟩