Modular Active Curiosity-Driven Discovery of Tool Use

Sébastien Forestier 1, 2 Pierre-Yves Oudeyer 1
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : This article studies algorithms used by a learner to explore high-dimensional structured sensorimotor spaces such as in tool use discovery. In particular, we consider goal babbling architectures that were designed to explore and learn solutions to fields of sensorimotor problems, i.e. to acquire inverse models mapping a space of parameterized sensorimotor problems/effects to a corresponding space of parameterized motor primitives. However, so far these architectures have not been used in high-dimensional spaces of effects. Here, we show the limits of existing goal babbling architectures for efficient exploration in such spaces, and introduce a novel exploration architecture called Model Babbling (MB). MB exploits efficiently a modular representation of the space of parameterized problems/effects. We also study an active version of Model Babbling (the MACOB architecture). These architectures are compared in a simulated experimental setup with an arm that can discover and learn how to move objects using two tools with different properties, embedding structured high-dimensional continuous motor and sensory spaces.
Liste complète des métadonnées

Cited literature [30 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01384566
Contributor : Sébastien Forestier <>
Submitted on : Thursday, October 20, 2016 - 11:01:13 AM
Last modification on : Monday, December 17, 2018 - 10:26:20 AM

File

Forestier2016Modular.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01384566, version 1

Citation

Sébastien Forestier, Pierre-Yves Oudeyer. Modular Active Curiosity-Driven Discovery of Tool Use. IEEE/RSJ International Conference on Intelligent Robots and Systems, 2016, Daejeon, South Korea. ⟨hal-01384566⟩

Share

Metrics

Record views

236

Files downloads

522