Skip to Main content Skip to Navigation
Conference papers

Audiovisual binding in speech perception

Jean-Luc Schwartz 1
1 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole
GIPSA-DPC - Département Parole et Cognition, GIPSA-PPC - GIPSA Pôle Parole et Cognition
Abstract : We have been elaborating in the last years in Grenoble a series of experimental works in which we attempt to show that audiovisual speech perception comprises an “audiovisual binding” stage before fusion and decision. This stage would be in charge to extract and associate the auditory and visual cues corresponding to a given speech source, before further categorisation processes could take place at a higher stage. We developed paradigms to characterize audiovisual binding in terms of both “streaming” and “chunking” adequate pieces of information. This can lead to elements of a possible computational model, in relation with a larger theoretical perceptuo-motor framework for speech perception, the “Perception-for-Action-Control” Theory.
Complete list of metadatas
Contributor : Jean-Luc Schwartz <>
Submitted on : Monday, April 3, 2017 - 9:39:04 AM
Last modification on : Thursday, May 14, 2020 - 1:32:52 AM


  • HAL Id : hal-01214088, version 1



Jean-Luc Schwartz. Audiovisual binding in speech perception. 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. ⟨hal-01214088⟩



Record views


Files downloads