Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Conference papers

Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual Objects

Florent Berthaut 1, 2 Cagan Arslan 1, 2 Laurent Grisoni 1, 2 
1 MINT2 - Méthodes et outils pour l'Interaction à gestes
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : Gestural interfaces, which make use of physiological signals, hand / body postures or movements, have become widespread for musical expression. While they may increase the transparency and expressiveness of instruments, they may also result in limited agency, for musicians as well as for spectators. This problem becomes especially true when the implemented mappings between gesture and music are subtle or complex. These instruments may also restrict the appropriation possibilities of controls, by comparison to physical interfaces. Most existing solutions to these issues are based on distant and/or limited visual feedback (LEDs, small screens). Our approach is to augment the gestures themselves with revealed virtual objects. Our contributions are, first a novel approach of visual feedback that allow for additional expressiveness, second a software pipeline for pixel-level feedback and control that ensures tight coupling between sound and visuals, and third, a design space for extending gestural control using revealed interfaces. We also demonstrate and evaluate our approach with the augmentation of three existing gestural musical instruments.
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download
Contributor : Florent Berthaut Connect in order to contact the contributor
Submitted on : Thursday, May 4, 2017 - 10:01:52 PM
Last modification on : Wednesday, March 23, 2022 - 3:51:22 PM
Long-term archiving on: : Saturday, August 5, 2017 - 1:54:16 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License


  • HAL Id : hal-01518579, version 1


Florent Berthaut, Cagan Arslan, Laurent Grisoni. Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual Objects. International Conference on New Interfaces for Musical Expression, May 2017, Copenhagen, Denmark. ⟨hal-01518579⟩



Record views


Files downloads