Audiovisual Binding for Speech Perception in Noise and in Aging

Attigodu Chandrashekara Ganesh Frédéric Berthommier 1 Jean-Luc Schwartz 1
1 GIPSA-PCMD - PCMD
GIPSA-DPC - Département Parole et Cognition
Abstract : Speech Perception involves fusion of multiple sensory input and it doesn’t fuse automatically, perhaps it depends on numerous external/internal factors (e.g. attention, noise or age). In this paper, we exploit a specific paradigm in which a short audiovisual context made of coherent or incoherent speech material is displayed before an incongruent audiovisual target likely to provide fusion (McGurk effect, McGurk & MacDonald, 1976). We confirm that incoherent context leads to unbinding, that is a reduction in the amount of fusion. Importantly, adding acoustic noise in the context though not in the target increases fusion. This suggests that listeners systematically evaluate the reliability of their sensory channels and weight them accordingly in the fusion process. We also show that older subjects display more unbinding, and discuss the potential consequences concerning their ability to understand speech in adverse conditions. We relate all these data to a “Binding-and-Fusion” model of audiovisual speech perception.
Type de document :
Article dans une revue
Language Learning, Wiley, 2017, 〈10.1111/lang.12271〉
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01615573
Contributeur : Jean-Luc Schwartz <>
Soumis le : jeudi 12 octobre 2017 - 15:44:51
Dernière modification le : jeudi 12 avril 2018 - 11:03:45

Fichiers

Main Document_Final_Final.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Attigodu Chandrashekara Ganesh, Frédéric Berthommier, Jean-Luc Schwartz. Audiovisual Binding for Speech Perception in Noise and in Aging. Language Learning, Wiley, 2017, 〈10.1111/lang.12271〉. 〈hal-01615573〉

Partager

Métriques

Consultations de la notice

431

Téléchargements de fichiers

154