From shape to sound: sonification of two dimensional curves by reenaction of biological movements

Etienne Thoret (1) , Mitsuko Aramaki (1) , Richard Kronland-Martinet (1) , Jean-Luc Velay (2) , Sølvi Ystad (1)

1 Sons
2 LNC - Laboratoire de Neurosciences Cognitives [Marseille]

Sonifying two dimensional data is a common problem. In this study, we propose a method to synthesize sonic metaphors of two dimensional curves based on the mental representation of the sound produced by the friction of the pencil when somebody is drawing or writing on a paper. The relevance of such approach is firstly presented. Secondly, synthesis of friction sounds allows to investigate the relevance of the kinematics in the perception of a gesture underlying a sound. In third part, a biological law linking the curvature of a shape to the velocity of the gesture which have draw the shape is calibrated from the auditory point of view. It enables to generate friction sounds with a physically based synthesis model from a given shape.

Mots clés: Gesture; Sonification; Sound Perception; Friction sounds; Scraping; 2/3-power law; Drawings

Domaines: Acoustique [physics.class-ph]; Acoustique [physics.class-ph]; Psychologie; Son [cs.SD]

Etienne Thoret, Mitsuko Aramaki, Richard Kronland-Martinet, Jean-Luc Velay, Sølvi Ystad. From shape to sound: sonification of two dimensional curves by reenaction of biological movements. Music and Emotions - 9th International Symposium on Computer Music Modeling and Retrieval (CMMR), 19-22 June, London, 2012, Jun 2012, Londres, United Kingdom. pp.XX. ⟨hal-00866384⟩