Linking Motion Sensors and Digital Signal Processing for Real-Time Musical Transformations

Mathieu Mazuel (1) , Dominique David (1) , Laurent Girin (2)

1 CEA-LETI - Commissariat à l'énergie atomique et aux énergies alternatives - Laboratoire d'Electronique et de Technologie de l'Information
2 GIPSA-MAGIC - GIPSA - Machines parlantes, Gestes oro-faciaux, Interaction Face-à-face, Communication augmentée

In this paper we propose some practical applications linking motion capture and real-time music transformation via the gestural control of digital signal processing (DSP) algorithms dedicated to sound / music processing. The use of a specific accelerometer / magnetometer sensor and related real-time signal acquisition and processing device is described. The presented applications provide some examples of original ways to control musical features such as tempo. This work feeds the media interaction interfaces field with a new approach based on rhythmical gestures and modulations mapped gestures. This work is extendable to new interactions in the areas of gaming and entertainment.

Mots clés: audio processing; music processing; haptic interface

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Mathieu Mazuel, Dominique David, Laurent Girin. Linking Motion Sensors and Digital Signal Processing for Real-Time Musical Transformations. HAID 2010 - 5th International Workshop Haptic Audio Interaction Design, Sep 2010, Copenhague, Denmark. pp.HAID2010. ⟨hal-00535694⟩