Audiovisual Binding for Speech Perception in Noise and in Aging

Attigodu Chandrashekara Ganesh 1 Frédéric Berthommier 1 Jean-Luc Schwartz 1
GIPSA-DPC - Département Parole et Cognition
Abstract : Speech Perception involves fusion of multiple sensory input and it doesn’t fuse automatically, perhaps it depends on numerous external/internal factors (e.g. attention, noise or age). In this paper, we exploit a specific paradigm in which a short audiovisual context made of coherent or incoherent speech material is displayed before an incongruent audiovisual target likely to provide fusion (McGurk effect, McGurk & MacDonald, 1976). We confirm that incoherent context leads to unbinding, that is a reduction in the amount of fusion. Importantly, adding acoustic noise in the context though not in the target increases fusion. This suggests that listeners systematically evaluate the reliability of their sensory channels and weight them accordingly in the fusion process. We also show that older subjects display more unbinding, and discuss the potential consequences concerning their ability to understand speech in adverse conditions. We relate all these data to a “Binding-and-Fusion” model of audiovisual speech perception.
Type de document :
Article dans une revue
Language Learning, Wiley, 2017, 〈10.1111/lang.12271〉
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger
Contributeur : Jean-Luc Schwartz <>
Soumis le : jeudi 12 octobre 2017 - 15:44:51
Dernière modification le : vendredi 21 décembre 2018 - 01:19:14


Main Document_Final_Final.pdf
Fichiers produits par l'(les) auteur(s)




Attigodu Chandrashekara Ganesh, Frédéric Berthommier, Jean-Luc Schwartz. Audiovisual Binding for Speech Perception in Noise and in Aging. Language Learning, Wiley, 2017, 〈10.1111/lang.12271〉. 〈hal-01615573〉



Consultations de la notice


Téléchargements de fichiers