From sound to shape: auditory perception of drawing movements

Etienne Thoret 1, * Mitsuko Aramaki 1 Richard Kronland-Martinet 1 Jean-Luc Velay 2 Solvi Ystad 1
* Auteur correspondant
1 Sons
LMA - Laboratoire de Mécanique et d'Acoustique [Marseille]
Abstract : This study investigates the human ability to perceive biological movements through friction sounds produced by drawings and, furthermore, the ability to recover drawn shapes from the friction sounds generated. In a first experiment, friction sounds, real-time synthesized and modulated by the velocity profile of the drawing gesture, revealed that subjects associated a biological movement to those sounds whose timbre variations were generated by velocity profiles following the 1/3 power law. This finding demonstrates that sounds can adequately inform about human movements if their acoustic characteristics are in accordance with the kinematic rule governing actual movements. Further investigations of our ability to recognize drawn shapes were carried out in two association tasks in which both recorded and synthesized sounds had to be associated to both distinct and similar visual shapes. Results revealed that, for both synthesized and recorded sounds, subjects made correct associations for distinct shapes, while some confusion was observed for similar shapes. The comparisons made between recorded and synthesized sounds lead to conclude that the timbre variations induced by the velocity profile enabled the shape recognition. The results are discussed in the context of the ecological and ideomotor frameworks.
Type de document :
Article dans une revue
Journal of Experimental Psychology: Human Perception and Performance, American Psychological Association, 2014, 40 (3), pp.983-994. 〈10.1037/a0035441〉
Liste complète des métadonnées

Littérature citée [55 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00939025
Contributeur : Etienne Thoret <>
Soumis le : mercredi 29 janvier 2014 - 23:14:44
Dernière modification le : jeudi 13 octobre 2016 - 01:03:10
Document(s) archivé(s) le : dimanche 9 avril 2017 - 02:47:30

Fichier

thoret2013d.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Etienne Thoret, Mitsuko Aramaki, Richard Kronland-Martinet, Jean-Luc Velay, Solvi Ystad. From sound to shape: auditory perception of drawing movements. Journal of Experimental Psychology: Human Perception and Performance, American Psychological Association, 2014, 40 (3), pp.983-994. 〈10.1037/a0035441〉. 〈hal-00939025〉

Partager

Métriques

Consultations de
la notice

572

Téléchargements du document

346