InkSplorer: Exploring Musical Ideas on Paper and Computer

Jérémie Garcia (1, 2) , Theophanis Tsandilas (1) , Carlos Agon (2) , Wendy Mackay (1)

1 IN-SITU - Situated interaction
2 IRCAM - Institut de Recherche et Coordination Acoustique/Musique

We conducted three studies with contemporary music composers at IRCAM. We found that even highly computer-literate composers use an iterative process that begins with expressing musical ideas on paper, followed by active parallel exploration on paper and in software, prior to final execution of their ideas as an original score. We conducted a participatory design study that focused on the creative exploration phase, to design tools that help composers better integrate their paper-based and electronic activities. We then developed InkSplorer as a technology probe that connects users' hand-written gestures on paper to Max/MSP and OpenMusic. Composers appropriated InkSplorer according to their preferred composition styles, emphasizing its ability to help them quickly explore musical ideas on paper as they interact with the computer. We conclude with recommendations for designing interactive paper tools that support the creative process, letting users explore musical ideas both on paper and electronically.

Mots clés: Creativity; Composer; Design Exploration; Interactive Paper; OpenMusic; Technology Probes

Domaines: Interface homme-machine [cs.HC]

Jérémie Garcia, Theophanis Tsandilas, Carlos Agon, Wendy Mackay. InkSplorer: Exploring Musical Ideas on Paper and Computer. New Interfaces for Musical Expression (NIME 2011), May 2011, Oslo, Norway. ⟨inria-00600083⟩