A possible neurophysiological correlate of audiovisual binding and unbinding in speech perception

Ganesh Attigodu (1) , Frédéric Berthommier (1) , Coriandre Emmanuel Vilain (2, 1) , Marc Sato (3) , Jean-Luc Schwartz (1)

1 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole
2 GIPSA-Services - GIPSA-Services
3 LPL - Laboratoire Parole et Langage

Audiovisual (AV) speech integration of auditory and visual streams generally ends up in a fusion into a single percept. One classical example is the McGurk effect in which incongruent auditory and visual speech signals may lead to a fused percept different from either visual or auditory inputs. In a previous set of experiments, we showed that if a McGurk stimulus is preceded by an incongruent AV context (composed of incongruent auditory and visual speech materials) the amount of McGurk fusion is largely decreased. We interpreted this result in the framework of a two-stage " binding and fusion " model of AV speech perception, with an early AV binding stage controlling the fusion/decision process and likely to produce " unbinding " with less fusion if the context is incoherent. In order to provide further electrophysiological evidence for this binding/unbinding stage, early auditory evoked N1/P2 responses were here compared during auditory, congruent and incongruent AV speech perception, according to either prior coherent or incoherent AV contexts. Following the coherent context, in line with previous electroencephalographic/magnetoencephalographic studies, visual information in the congruent AV condition was found to modify auditory evoked potentials, with a latency decrease of P2 responses compared to the auditory condition. Importantly, both P2 amplitude and latency in the congruent AV condition increased from the coherent to the incoherent context. Although potential contamination by visual responses from the visual cortex cannot be discarded, our results might provide a possible neurophysiological correlate of early binding/unbinding process applied on AV interactions.

Mots clés: audiovisual binding; speech perception; multisensory interactions; EEG

Domaines: Sciences cognitives

Ganesh Attigodu, Frédéric Berthommier, Coriandre Emmanuel Vilain, Marc Sato, Jean-Luc Schwartz. A possible neurophysiological correlate of audiovisual binding and unbinding in speech perception. Frontiers in Psychology, 2014, Multisensory and sensorimotor interactions in speech perception, 5, ⟨10.3389/fpsyg.2014.01340⟩. ⟨hal-01220444⟩