Ventriloquism effect with sound stimuli varying in both azimuth and elevation

Etienne Hendrickx (1) , Mathieu Paquier (1) , Vincent Koehl (1) , Julian Palacino (1)

1 Lab-STICC_UBO_CID_IHSEV

When presented with a spatially discordant auditory-visual stimulus, subjects sometimes perceive the sound and the visual stimuli as coming from the same location. Such a phenomenon is often referred to as perceptual fusion or ventriloquism, as it evokes the illusion created by a ventriloquist when his voice seems to emanate from his puppet rather than from his mouth. While this effect has been extensively examined in the horizontal plane and to a lesser extent in distance, few psychoacoustic studies have focused on elevation. In the present experiment, sequences of a man talking were presented to subjects. His voice could be reproduced on different loudspeakers, which created disparities in both azimuth and elevation between the sound and the visual stimuli. For each presentation, subjects had to indicate whether the voice seemed to emanate from the mouth of the actor or not. Results showed that ventriloquism could be observed with larger audiovisual disparities in elevation than in azimuth.

Domaines: Acoustique [physics.class-ph]; Acoustique [physics.class-ph]

Etienne Hendrickx, Mathieu Paquier, Vincent Koehl, Julian Palacino. Ventriloquism effect with sound stimuli varying in both azimuth and elevation. Journal of the Acoustical Society of America, 2015, 138 (6), pp.3686-3697. ⟨10.1121/1.4937758⟩. ⟨hal-01246179⟩