Audio-Motor Synchronization: The Effect of Mapping Between Kinematics and Acoustic Cues on Geometric Motor Features

Etienne Thoret (1) , Mitsuko Aramaki (1) , Christophe Bourdin (2) , Lionel Bringoux (2) , Richard Kronland-Martinet (1) , Sølvi Ystad (1)

1 Sons
2 ISM - Institut des Sciences du Mouvement Etienne Jules Marey

This paper presents an experiment dealing with the sensorimotor relation between auditory perception and graphical movements. Subjects were asked to synchronize their gestures with synthetic friction sounds. Some geometrical and dynamical parameters of the motor productions are analyzed according to the different mappings. This experiment provides a formal framework for a wider study which aims to evaluate the relation between audition, vision and gestures.

Mots clés: Auditory perception; sensorimotor loop; friction sounds; gestures

Domaines: Acoustique [physics.class-ph]; Son [cs.SD]; Sciences cognitives; Psychologie

Etienne Thoret, Mitsuko Aramaki, Christophe Bourdin, Lionel Bringoux, Richard Kronland-Martinet, et al.. Audio-Motor Synchronization: The Effect of Mapping Between Kinematics and Acoustic Cues on Geometric Motor Features. Sound, Music and Motion, 2014. ⟨hal-01085137⟩