A tabletop instrument for manipulation of sound morphologies with hands, fingertips and upper-body

Edgar Hemery (1) , Sotiris Manitsaris (1) , Fabien Moutarde (1)

1 CAOR - Centre de Robotique

We present a musical instrument, named the Embodied Musical Instrument (EMI) which allows musicians to perform free gestures with the upper–body including hands and fingers thanks to 3D vision sensors, arranged around the tabletop. 3D interactive spaces delimit the boundaries in which the player performs metaphorical gestures in order to play with sound synthesis engines. A physical-based sound synthesis engine and a sampler have been integrated in the system in order to manipulate sound morphologies in the context of electro-acoustic and electronic composition.

Mots clés: Sound image; Gesture data recording; Gesture Recognition; Physical-based sound synthesis; Morphological transformations

Domaines: Interface homme-machine [cs.HC]; Son [cs.SD]; Musique, musicologie et arts de la scène

Edgar Hemery, Sotiris Manitsaris, Fabien Moutarde. A tabletop instrument for manipulation of sound morphologies with hands, fingertips and upper-body. 3rd International Symposium on Movement and Computing (MOCO'2016), Jul 2016, Thessalonique, Greece. pp.25, ⟨10.1145/2948910.2948946⟩. ⟨hal-01425898⟩