3D interaction techniques for musical expression

Abstract : As Virtual Reality headsets become accessible, more and more artistic applications are developed, including immersive musical instruments. 3D interaction techniques designed in the 3D User Interfaces research community, such as navigation, selection and manipulation techniques, open numerous opportunities for musical control. For example, navigation techniques such as teleportation, free walking/flying and path-planning enable different ways of accessing musical scores, scenes of spatialized sounds sources or even parameter spaces. Manipulation techniques provide novel gestures and metaphors, e.g. for drawing or sculpting sound entities. Finally, 3D selection techniques facilitate the interaction with complex visual structures which can represent hierarchical temporal structures, audio graphs, scores or parameter spaces. However, existing devices and techniques were developed mainly with a focus on efficiency, i.e. minimising error rate and task completion times. They were therefore not designed with the specifics of musical interaction in mind. In this paper , we review existing 3D interaction techniques and examine how they can be used for musical control, including the possibilities they open for instrument designers. We then propose a number of research directions to adapt and extend 3DUIs for musical expression
Complete list of metadatas

Cited literature [71 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02430634
Contributor : Florent Berthaut <>
Submitted on : Tuesday, January 7, 2020 - 2:30:34 PM
Last modification on : Monday, January 13, 2020 - 1:19:59 AM

File

interactapasample_auth.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Florent Berthaut. 3D interaction techniques for musical expression. Journal of New Music Research, Taylor & Francis (Routledge), In press, ⟨10.1080/09298215.2019.1706584⟩. ⟨hal-02430634⟩

Share

Metrics

Record views

23

Files downloads

27