Combining audiovisual mappings for 3D musical interaction

Florent Berthaut 1 Myriam Desainte-Catherine 1 Martin Hachet 1, 2
2 IPARLA - Visualization and manipulation of complex data on wireless mobile devices
Université Sciences et Technologies - Bordeaux 1, Inria Bordeaux - Sud-Ouest, École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), CNRS - Centre National de la Recherche Scientifique : UMR5800
Abstract : 3D environments provide new possibilities for musical interaction. They allow musicians to manipulate and visualize large sets of sound processes associated to 3D objects by connecting graphical parameters to sound parameters. Several of these audiovisual mappings can be combined on a single 3D object. However, this brings up the issues of the choice of these mappings and of their combinations. We conducted a user study on sixteen musicians to evaluate audiovisual mappings and their combinations in the context of 3D musical interaction. This user study is composed of three experiments. The first experiment investigates subjects preferences for mappings between four perceptual sound parameters (amplitude, pitch, spectral centroid and noisiness) and ten graphical parameters, some of them specific to 3D environments. The second experiment focuses on efficiency of single mappings in an audiovisual identification task. The results show almost no significant differences, but some tendencies, which may indicate that the choice of mappings scales is more important than the choice of the mappings themselves. The third experiment investigates the efficiency of mappings combinations. The results indicate no significant differences, which suggest that it may be possible to combine up to four audiovisual mappings on a single graphical object without any performance loss for musicians, if they do not disrupt each other.
Type de document :
Communication dans un congrès
International Computer Music Conference, Jun 2010, New york, United States. p 100, 2010
Liste complète des métadonnées

Littérature citée [15 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00530076
Contributeur : Florent Berthaut <>
Soumis le : mercredi 27 octobre 2010 - 12:38:05
Dernière modification le : vendredi 11 septembre 2015 - 01:06:47
Document(s) archivé(s) le : vendredi 26 octobre 2012 - 12:26:09

Fichier

mappings.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00530076, version 1

Collections

Citation

Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Combining audiovisual mappings for 3D musical interaction. International Computer Music Conference, Jun 2010, New york, United States. p 100, 2010. 〈hal-00530076〉

Partager

Métriques

Consultations de la notice

375

Téléchargements de fichiers

133