Autonomous Sensorimotor Learning for Sound Source Localization by a Humanoid Robot

Quan Nguyen 1 Laurent Girin 1 Gérard Bailly 1 Frédéric Elisei 1, 2 Duc-Canh Nguyen 1
1 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
2 GIPSA-Services - GIPSA-Services
GIPSA-lab - Grenoble Images Parole Signal Automatique
Abstract : We consider the problem of learning to localize a speech source using a humanoid robot equipped with a binaural hearing system. We aim to map binaural audio features into the relative angle between the robot's head direction and the target source direction based on a sensorimotor training framework. To this end, we make the following contributions: (i) a procedure to automatically collect and label audio and motor data for sensorimotor training; (ii) the use of a convolutional neural network (CNN) trained with white noise signal and ground truth relative source direction. Experimental evaluation with speech signals shows that the CNN can localize the speech source even without an explicit algorithm for dealing with missing spectral features.
Type de document :
Communication dans un congrès
Workshop on Crossmodal Learning for Intelligent Robotics in conjunction with IEEE/RSJ IROS, Oct 2018, Madrid, Spain
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01921882
Contributeur : Gérard Bailly <>
Soumis le : mercredi 14 novembre 2018 - 10:41:24
Dernière modification le : vendredi 30 novembre 2018 - 15:47:31

Fichier

IROS2018_CLIR_Quan_camera_read...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01921882, version 1

Collections

Citation

Quan Nguyen, Laurent Girin, Gérard Bailly, Frédéric Elisei, Duc-Canh Nguyen. Autonomous Sensorimotor Learning for Sound Source Localization by a Humanoid Robot. Workshop on Crossmodal Learning for Intelligent Robotics in conjunction with IEEE/RSJ IROS, Oct 2018, Madrid, Spain. 〈hal-01921882〉

Partager

Métriques

Consultations de la notice

48

Téléchargements de fichiers

59