Skip to Main content Skip to Navigation
Conference papers

Which criteria for autonomously shifting between goal-directed and habitual behaviors in robots?

Abstract : Research in the fields of Psychology and Neuroscience have provided strong evidence that mammals can adaptively switch between goal-directed behaviors - i.e. deliberative decisions based on costly but flexible planned long-term consequences of actions - and habitual behaviors - i.e. reactive behaviors that are efficient when the environment is stable but inflexible in the case of environmental changes. However, the computational principles underlying this switching ability are not yet understood, and several alternative criteria have been proposed, each tested on specific subsets of experimental datasets. Here we present a neurorobotic implementation and comparison of such type of criteria, plus some new ones imported from the field of ensemble reinforcement learning, with a twofold objective: on the one hand exploring the possible efficiency of such bio-inspired principles to enable robots to have more behavioral flexibility during autonomous development and learning; on the other hand, analyzing whether an asynchronous continuous robotic simulation and comparison of these criteria in a common task can feed current debates in the Psychological and Neuroscience fields. We evaluate these methods in an apparently simple repetitive cube-pushing task on a simulated conveyor belt, but which imposes to the robot constant trade-offs between speed and accuracy and between stability and abrupt changes. Our results show that if overall performance is not improved by using multiple behavioral systems in a stable environment, these methods allow for a better adaptation to environmental changes. The Voting methods and Boltzmann addition, from ensemble reinforcement learning, give the best performance, providing an interesting alternative to Expert selection.
Document type :
Conference papers
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02108755
Contributor : Projet Dissemin <>
Submitted on : Wednesday, April 24, 2019 - 1:39:18 PM
Last modification on : Friday, March 19, 2021 - 3:32:54 AM

File

article.pdf
Files produced by the author(s)

Identifiers

Citation

Erwan Renaudo, Benoît Girard, Raja Chatila, Mehdi Khamassi. Which criteria for autonomously shifting between goal-directed and habitual behaviors in robots?. 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Aug 2015, Providence, RI, United States. ⟨10.1109/devlrn.2015.7346152⟩. ⟨hal-02108755⟩

Share

Metrics

Record views

409

Files downloads

935