Musink: Composing Music through Augmented Drawing

Theophanis Tsandilas (1) , Catherine Letondal (1) , Wendy Mackay (1)

1 IN-SITU - Situated interaction

We focus on the creative use of paper in the music composition process, particularly the interaction between paper and end-user programming. When expressing musical ideas, composers draw in a precise way, not just sketch. Working in close collaboration with composers, we designed Musink to provide them with a smooth transition between paper drawings and OpenMusic, a flexible music composition tool. Musink's built-in recognizers handle common needs, such as scoping and annotation. Users can also define new gestures and associate them with their own or predefined software functions. Musink supports semi-structured, delayed interpretation and serves as a customizable gesture browser, giving composers significant freedom to create their own, individualized composition lan-guages and to experiment with music, on-paper and on-line

Mots clés: gesture interfaces; Creativity; interactive paper; participatory design; musical interfaces; end-user programming; gesture interfaces.

Domaines: Interface homme-machine [cs.HC]

Theophanis Tsandilas, Catherine Letondal, Wendy Mackay. Musink: Composing Music through Augmented Drawing. International conference on Human factors in computing systems, Apr 2009, Boston, United States. pp.819-828, ⟨10.1145/1518701.1518827⟩. ⟨hal-00589698⟩