Virtual Auditory Myography of Timpani-playing Avatars

Florian Grond (1) , Alexandre Bouënard (2) , Thomas Hermann (1) , Marcelo M. Wanderley (2)

1 Universität Bielefeld = Bielefeld University
2 IDMIL - Input Devices and Music Interaction Laboratory

Music performance is highly related to instrumentalists' movements and one of the biggest challenges is the identification and understanding of gesture strategies according to the plethora of musical nuances (dynamics, tempo, etc..) available to performers. During these past few years, a novel approach has been elaborated, consisting in studying movement strategies through auditory rendering. In this paper, we focus on the auditory analysis of timpani (percussion) gestures. We present a novel interface combining movement simulation and sonification as a means of enhancing the auditory analysis of timpani gestures. We further report the results from an evaluation of this interface, where we study the contributions of sonification to the multimodal display.

Domaines: Modélisation et simulation; Multimédia [cs.MM]

Florian Grond, Alexandre Bouënard, Thomas Hermann, Marcelo M. Wanderley. Virtual Auditory Myography of Timpani-playing Avatars. International Conference on Digital Audio Effects (DAFX), Sep 2010, Austria. pp.135-142. ⟨hal-00617311⟩