Audiovisual binding in speech perception

Jean-Luc Schwartz 1
1 GIPSA-PCMD - PCMD
GIPSA-DPC - Département Parole et Cognition
Abstract : We have been elaborating in the last years in Grenoble a series of experimental works in which we attempt to show that audiovisual speech perception comprises an “audiovisual binding” stage before fusion and decision. This stage would be in charge to extract and associate the auditory and visual cues corresponding to a given speech source, before further categorisation processes could take place at a higher stage. We developed paradigms to characterize audiovisual binding in terms of both “streaming” and “chunking” adequate pieces of information. This can lead to elements of a possible computational model, in relation with a larger theoretical perceptuo-motor framework for speech perception, the “Perception-for-Action-Control” Theory.
Type de document :
Communication dans un congrès
1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. Audiovisual Speech Processing (FAAVSP 2015), 2015
Liste complète des métadonnées

Littérature citée [3 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01214088
Contributeur : Jean-Luc Schwartz <>
Soumis le : lundi 3 avril 2017 - 09:39:04
Dernière modification le : lundi 9 avril 2018 - 12:22:49

Identifiants

  • HAL Id : hal-01214088, version 1

Collections

Citation

Jean-Luc Schwartz. Audiovisual binding in speech perception. 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. Audiovisual Speech Processing (FAAVSP 2015), 2015. 〈hal-01214088〉

Partager

Métriques

Consultations de la notice

273

Téléchargements de fichiers

17