Modulating fusion in the McGurk effect by binding processes and contextual noise - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Modulating fusion in the McGurk effect by binding processes and contextual noise

Résumé

In a series of experiments we showed that the McGurk effect may be modulated by context: applying incoherent auditory and visual material before an audiovisual target made of an audio "ba" and a video "ga" significantly decreases the McGurk effect. We interpreted this as showing the existence of an audiovisual "binding" stage controlling the fusion process. Incoherence would produce "unbinding" and result in decreasing the weight of the visual input in the fusion process. In this study, we further explore this binding stage around two experiments. Firstly we test the "rebinding" process, by presenting a short period of either coherent material or silence after the incoherent "unbinding" context. We show that coherence provides "rebinding", resulting in a recovery of the McGurk effect. In contrary, silence provides no rebinding and hence "freezes" the unbinding process, resulting in no recovery of the McGurk effect. Capitalizing on this result, in a second experiment including an incoherent unbinding context followed by a coherent rebinding context before the target, we add noise all over the contextual period, though not in the McGurk target. It appears that noise uniformly increases the rate of McGurk responses compared to the silent condition. This suggests that contextual noise increases the weight of the visual input in fusion, even if there is no noise within the target stimulus where fusion is applied. We conclude on the role of audiovisual coherence and noise in the binding process, in the framework of audiovisual speech scene analysis and the cocktail party effect.

Domaines

Psychologie
Fichier principal
Vignette du fichier
GiG_AVSP13_full_paper_final.pdf (402.42 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00941306 , version 1 (03-02-2014)

Identifiants

  • HAL Id : hal-00941306 , version 1

Citer

Olha Nahorna, Ganesh Attigodu, Frédéric Berthommier, Jean-Luc Schwartz. Modulating fusion in the McGurk effect by binding processes and contextual noise. AVSP 2013 - 12th International Conference on Auditory-Visual Speech Processing, Aug 2013, Annecy, France. pp.181-186. ⟨hal-00941306⟩
355 Consultations
199 Téléchargements

Partager

Gmail Facebook X LinkedIn More