Audiovisual Speech Scene Analysis in the Context of Competing Sources

Abstract : Audiovisual fusion in speech perception is generally conceived as a process independent from scene analysis, which is supposed to occur separately in the auditory and visual domain. On the contrary, we have been proposing in the last years that scene analysis such as what takes place in the cocktail party effect was an audiovisual process. We review here a series of experiments illustrating how audiovisual speech scene analysis occurs in the context of competing sources. Indeed, we show that a short contextual audiovisual stimulus made of competing auditory and visual sources modifies the perception of a following McGurk target. We interpret this in terms of binding, unbinding and rebinding processes, and we show how these processes depend on audiovisual correlations in time, attentional processes and differences between junior and senior participants.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [29 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01405509
Contributor : Jean-Luc Schwartz <>
Submitted on : Wednesday, November 30, 2016 - 10:04:56 AM
Last modification on : Monday, April 9, 2018 - 12:22:49 PM
Document(s) archivé(s) le : Monday, March 27, 2017 - 8:45:33 AM

File

0062anav.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Attigodu Ganesh, Frédéric Berthommier, Jean-Luc Schwartz. Audiovisual Speech Scene Analysis in the Context of Competing Sources. 17th Annual Conference of the International Speech Communication Association (Interspeech 2016), Sep 2016, San Francisco, United States. Proceedings Interspeech 2016, 2016, pp.47 - 51, 2016, Proceedings Interspeech 2016. 〈10.21437/Interspeech.2016-62〉. 〈hal-01405509〉

Share

Metrics

Record views

1939

Files downloads

104