The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments

Abstract : Mobile devices have been a promising platform for musical performance thanks to the various sensors readily available on board. In particular, mobile cameras can provide rich input as they can capture a wide variety of user gestures or environment dynamics. However, this raw camera input only provides continuous parameters and requires expensive computation. In this paper, we propose combining camera based motion/gesture input with the touch input, in order to filter movement information both temporally and spatially , thus increasing expressiveness while reducing computation time. We present a design space which demonstrates the diversity of interactions that our technique enables. We also report the results of a user study in which we observe how musicians appropriate the interaction space with an example instrument.
Type de document :
Communication dans un congrès
NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01809210
Contributeur : Cagan Arslan <>
Soumis le : mercredi 6 juin 2018 - 15:01:22
Dernière modification le : vendredi 6 juillet 2018 - 09:55:46
Document(s) archivé(s) le : vendredi 7 septembre 2018 - 13:59:51

Fichier

Nime_18_PwF.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01809210, version 1

Citation

Cagan Arslan, Florent Berthaut, Jean Martinet, Ioan Marius Bilasco, Laurent Grisoni. The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments. NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States. 〈hal-01809210〉

Partager

Métriques

Consultations de la notice

153

Téléchargements de fichiers

57