Audiovisual binding in speech perception

Jean-Luc Schwartz 1
1 GIPSA-PCMD - PCMD
GIPSA-DPC - Département Parole et Cognition
Abstract : We have been elaborating in the last years in Grenoble a series of experimental works in which we attempt to show that audiovisual speech perception comprises an “audiovisual binding” stage before fusion and decision. This stage would be in charge to extract and associate the auditory and visual cues corresponding to a given speech source, before further categorisation processes could take place at a higher stage. We developed paradigms to characterize audiovisual binding in terms of both “streaming” and “chunking” adequate pieces of information. This can lead to elements of a possible computational model, in relation with a larger theoretical perceptuo-motor framework for speech perception, the “Perception-for-Action-Control” Theory.
Document type :
Conference papers
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01214088
Contributor : Jean-Luc Schwartz <>
Submitted on : Monday, April 3, 2017 - 9:39:04 AM
Last modification on : Monday, April 9, 2018 - 12:22:49 PM

Identifiers

  • HAL Id : hal-01214088, version 1

Collections

Citation

Jean-Luc Schwartz. Audiovisual binding in speech perception. 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. ⟨hal-01214088⟩

Share

Metrics

Record views

303

Files downloads

21