Imitating Operations On Internal Cognitive Structures for Language Aquisition

Thomas Cederborg 1 Pierre-Yves Oudeyer 2
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, ENSTA ParisTech U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : The paper examines the problem of learning socio-linguistic skills through imitation when those skills involve both observable motor patterns and internal unobservable cognitive operations. This approach is framed in a research program trying to investigate novel links between context-dependent motor learning by imitation and language acquisition. More precisely, the paper presents an algorithm allowing a robot to learn how to respond to communicative/linguistic actions of one human, called an interactant, by observing how another human, called a demonstrator, responds. As a response to 2 continuous communicative hand signs of the interactant, the demonstrator focuses on one out of three objects, and then performs a movement in relation to the object focused on. The response of the demonstrator, which depends on the context, including the hand signs produced by the interactant, is assumed to be appropriate and the robotic imitator uses these observations to build a general policy of how to respond to interactant actions. In this paper the communicative actions of the interactant are based on hand signs. The robot has to learn several things at the same time: 1) Weather it is the first sign or the second sign that specifies the object to focus on (that is, requests an internal cognitive operation), and the same for the request of a movement type. 2) How many hand signs there are and how to recognize them. 3) How many movement types there are and how to reproduce them in different contexts. 4) How to assign specific interactant hand signs to specific internal operations and specific movements. An algorithm is proposed based on a similarity metric between demonstrations, and an experiment is presented where the unseen ''focus on object" operation and the hand movements are successfully imitated, including in situations not observed during the demonstrations.
Type de document :
Communication dans un congrès
HUMANOIDS, 2011, Bled, Slovenia. pp.NA, 2011
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-00646913
Contributeur : Thomas Cederborg <>
Soumis le : jeudi 1 décembre 2011 - 00:48:26
Dernière modification le : jeudi 5 janvier 2017 - 01:53:15
Document(s) archivé(s) le : vendredi 16 novembre 2012 - 12:36:32

Fichier

Humanoids2011.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00646913, version 1

Collections

Citation

Thomas Cederborg, Pierre-Yves Oudeyer. Imitating Operations On Internal Cognitive Structures for Language Aquisition. HUMANOIDS, 2011, Bled, Slovenia. pp.NA, 2011. <hal-00646913>

Partager

Métriques

Consultations de
la notice

249

Téléchargements du document

133