Assessing sound perception through vocal imitations of sounds that evoke movements and materials

Thomas Bordonné (1) , Manuel Dias Alves (1, 2) , Mitsuko Aramaki (1) , Sølvi Ystad (1) , Richard Kronland-Martinet (1)

1 PRISM - Perception, Représentations, Image, Son, Musique
2 Pôle psychiatrie, Centre Hospitalier de Toulon

In this paper we studied a new approach to investigate sound perception. Assuming that a sound contains specific morphologies that convey perceptually relevant information responsible for its recognition, called invariants, we explored the possibility of a new method to determine such invariants, using vocal imitation. We conducted an experiment , asking participants to imitate sounds evoking movements and materials generated through a sound synthesizer. Given that that the sounds produced by the synthesizer were based on invariant structures, we aimed at retrieving this information from the imitations. Results showed that the participants were able to correctly imitate the dynamics of the sounds, i.e. the action-related information evoked by the sound, whereas texture-related information evoking the material of the sound source was less easily imitated.

Mots clés: Perception; Voice; Imitation; Invariant; LPC

Domaines: Son [cs.SD]; Modélisation et simulation; Acoustique [physics.class-ph]; Sciences cognitives; Acoustique [physics.class-ph]

Thomas Bordonné, Manuel Dias Alves, Mitsuko Aramaki, Sølvi Ystad, Richard Kronland-Martinet. Assessing sound perception through vocal imitations of sounds that evoke movements and materials. Computer Music Multidisciplinary Research (CMMR2017), Sep 2017, Matosinhos, Portugal. ⟨hal-01810880⟩