Skip to Main content Skip to Navigation
Journal articles

3D interaction techniques for musical expression

Abstract : As Virtual Reality headsets become accessible, more and more artistic applications are developed, including immersive musical instruments. 3D interaction techniques designed in the 3D User Interfaces research community, such as navigation, selection and manipulation techniques, open numerous opportunities for musical control. For example, navigation techniques such as teleportation, free walking/flying and path-planning enable different ways of accessing musical scores, scenes of spatialized sounds sources or even parameter spaces. Manipulation techniques provide novel gestures and metaphors, e.g. for drawing or sculpting sound entities. Finally, 3D selection techniques facilitate the interaction with complex visual structures which can represent hierarchical temporal structures, audio graphs, scores or parameter spaces. However, existing devices and techniques were developed mainly with a focus on efficiency, i.e. minimising error rate and task completion times. They were therefore not designed with the specifics of musical interaction in mind. In this paper , we review existing 3D interaction techniques and examine how they can be used for musical control, including the possibilities they open for instrument designers. We then propose a number of research directions to adapt and extend 3DUIs for musical expression
Complete list of metadata

Cited literature [71 references]  Display  Hide  Download
Contributor : Florent Berthaut Connect in order to contact the contributor
Submitted on : Tuesday, January 7, 2020 - 2:30:34 PM
Last modification on : Tuesday, January 4, 2022 - 6:50:40 AM


Files produced by the author(s)




Florent Berthaut. 3D interaction techniques for musical expression. Journal of New Music Research, Taylor & Francis (Routledge), In press, ⟨10.1080/09298215.2019.1706584⟩. ⟨hal-02430634⟩



Les métriques sont temporairement indisponibles