Binding and unbinding in audiovisual speech fusion: Removing the McGurk effect by an incoherent preceding audiovisual context

Olha Nahorna (1) , Frédéric Berthommier (1) , Jean-Luc Schwartz (1)

1 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole

The McGurk effect demonstrates the existence of a fusion process in audiovisual speech perception (McGurk & MacDonald, 1976). Recent experiments question the automaticity of this process (Alsius et al., 2005; Tiippana et al., 2004). We consider here the assumption that fusion is controlled by a conditional binding process, which can block fusion in the case of strong audiovisual inconsistencies. To test this hypothesis, we designed two experiments in which a consistent or inconsistent audiovisual context is placed before McGurk stimuli, and we show that inconsistent contexts can remove the McGurk effect.

Mots clés: McGurk effect; binding; multisensory fusion; AV speech perception and scene analysis

Domaines: Psychologie

Olha Nahorna, Frédéric Berthommier, Jean-Luc Schwartz. Binding and unbinding in audiovisual speech fusion: Removing the McGurk effect by an incoherent preceding audiovisual context. AVSP 2010 - 9th International Conference on Auditory-Visual Speech Processing, Sep 2010, Hakone, Kanagawa, Japan. Posters: Perception, Emotion, Interaction. ⟨hal-00538467⟩