Learning Movement Kinematics with a Targeted Sound

Eric O Boyer (1, 2) , Quentin Pyanet (1) , Sylvain Hanneton (2) , Frédéric Bevilacqua (1)

1 Equipe Interactions musicales temps-réel
2 LPP - UMR 8242 - Laboratoire Psychologie de la Perception

This study introduces an experiment designed to analyze the sensorimotor adaptation to a motion-based sound synthesis system. We investigated a sound-oriented learning task, namely to reproduce a tar- geted sound. The motion of a small handheld object was used to control a sound synthesizer. The object angular velocity was measured by a gy- roscope and transmitted in real time wirelessly to the sound system. The targeted sound was reached when the motion matched a given refer- ence angular velocity profile with a given accuracy. An incorrect velocity profile produced either a noisier sound or a sound with a louder high har- monic, depending on the sign of the velocity error. The results showed that the participants were generally able to learn to reproduce sounds very close to the targeted sound. A corresponding motor adaptation was also found to occur, at various degrees, in most of the participants when the profile is altered.

Mots clés: interactive sys- tems; sound-oriented task; gesture; learning; auditory feedback; sensorimotor; adaptation; sound

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Traitement du signal et de l'image [eess.SP]; Musique, musicologie et arts de la scène; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]

Eric O Boyer, Quentin Pyanet, Sylvain Hanneton, Frédéric Bevilacqua. Learning Movement Kinematics with a Targeted Sound. The 10th International Symposium on Computer Music Multidisciplinary Research (CMMR), Oct 2013, Marseille, France. pp.218-233. ⟨hal-01161078⟩