Audiovisual Binding for Speech Perception in Noise and in Aging

Attigodu Chandrashekara Ganesh 1 Frédéric Berthommier 1 Jean-Luc Schwartz 1
1 GIPSA-PCMD - PCMD
GIPSA-DPC - Département Parole et Cognition
Abstract : Speech Perception involves fusion of multiple sensory input and it doesn’t fuse automatically, perhaps it depends on numerous external/internal factors (e.g. attention, noise or age). In this paper, we exploit a specific paradigm in which a short audiovisual context made of coherent or incoherent speech material is displayed before an incongruent audiovisual target likely to provide fusion (McGurk effect, McGurk & MacDonald, 1976). We confirm that incoherent context leads to unbinding, that is a reduction in the amount of fusion. Importantly, adding acoustic noise in the context though not in the target increases fusion. This suggests that listeners systematically evaluate the reliability of their sensory channels and weight them accordingly in the fusion process. We also show that older subjects display more unbinding, and discuss the potential consequences concerning their ability to understand speech in adverse conditions. We relate all these data to a “Binding-and-Fusion” model of audiovisual speech perception.
Document type :
Journal articles
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01615573
Contributor : Jean-Luc Schwartz <>
Submitted on : Thursday, October 12, 2017 - 3:44:51 PM
Last modification on : Friday, December 21, 2018 - 1:19:14 AM

Files

Main Document_Final_Final.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Attigodu Chandrashekara Ganesh, Frédéric Berthommier, Jean-Luc Schwartz. Audiovisual Binding for Speech Perception in Noise and in Aging. Language Learning, Wiley, 2017, ⟨10.1111/lang.12271⟩. ⟨hal-01615573⟩

Share

Metrics

Record views

480

Files downloads

257