HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments

Abstract : Mobile devices have been a promising platform for musical performance thanks to the various sensors readily available on board. In particular, mobile cameras can provide rich input as they can capture a wide variety of user gestures or environment dynamics. However, this raw camera input only provides continuous parameters and requires expensive computation. In this paper, we propose combining camera based motion/gesture input with the touch input, in order to filter movement information both temporally and spatially , thus increasing expressiveness while reducing computation time. We present a design space which demonstrates the diversity of interactions that our technique enables. We also report the results of a user study in which we observe how musicians appropriate the interaction space with an example instrument.
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download

Contributor : Cagan Arslan Connect in order to contact the contributor
Submitted on : Wednesday, June 6, 2018 - 3:01:22 PM
Last modification on : Wednesday, March 23, 2022 - 3:51:22 PM
Long-term archiving on: : Friday, September 7, 2018 - 1:59:51 PM


Files produced by the author(s)


  • HAL Id : hal-01809210, version 1


Cagan Arslan, Florent Berthaut, Jean Martinet, Ioan Marius Bilasco, Laurent Grisoni. The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments. NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States. ⟨hal-01809210⟩



Record views


Files downloads