The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments

Abstract : Mobile devices have been a promising platform for musical performance thanks to the various sensors readily available on board. In particular, mobile cameras can provide rich input as they can capture a wide variety of user gestures or environment dynamics. However, this raw camera input only provides continuous parameters and requires expensive computation. In this paper, we propose combining camera based motion/gesture input with the touch input, in order to filter movement information both temporally and spatially , thus increasing expressiveness while reducing computation time. We present a design space which demonstrates the diversity of interactions that our technique enables. We also report the results of a user study in which we observe how musicians appropriate the interaction space with an example instrument.
Type de document :
Communication dans un congrès
New interfaces for musical expression, Jun 2018, Blacksburg, VA, United States
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01809210
Contributeur : Cagan Arslan <>
Soumis le : mercredi 6 juin 2018 - 15:01:22
Dernière modification le : jeudi 7 juin 2018 - 01:17:17

Fichier

Nime_18_PwF.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01809210, version 1

Collections

Citation

Cagan Arslan, Florent Berthaut, Jean Martinet, Ioan Marius Bilasco, Laurent Grisoni. The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments. New interfaces for musical expression, Jun 2018, Blacksburg, VA, United States. 〈hal-01809210〉

Partager

Métriques

Consultations de la notice

63

Téléchargements de fichiers

19