Real-Time Simulation and Interaction of Percussion Gestures with Sound Synthesis

Alexandre Bouënard (1, 2) , Sylvie Gibet (1) , Marcelo M. Wanderley (2)

1 VALORIA - Laboratoire de Recherche en Informatique et ses Applications de Vannes et Lorient
2 IDMIL - Input Devices and Music Interaction Laboratory

Virtual characters playing virtual musical instruments must interact in real-time with the sounding environment. Dynamic simulation is a promising approach to finely represent and modulate this interaction. Moreover, captured human motion can provide a database covering a large variety of gestures with various levels of expressivity. We propose in this paper a physics-based environment in which a virtual percussionist is dynamically controlled and interacts with a physics-based sound synthesis algorithm. We show how an asynchronous architecture, including motion and sound simulation, as well as visual and sound outputs can take advantage of the parameterization of both gesture and sound that influence the resulting virtual instrumental performance.

Mots clés: Physics Based Virtual Character Animation; Motion Control; Sound Synthesis

Domaines: Modélisation et simulation; Synthèse d'image et réalité virtuelle [cs.GR]; Son [cs.SD]; Multimédia [cs.MM]

Alexandre Bouënard, Sylvie Gibet, Marcelo M. Wanderley. Real-Time Simulation and Interaction of Percussion Gestures with Sound Synthesis. 2009. ⟨hal-00369254v2⟩