The Sound Space as Musical Instrument: Playing Corpus-Based Concatenative Synthesis

Diemo Schwarz (1)

1 Equipe Interactions musicales temps-réel

Corpus-based concatenative synthesis is a fairly recent sound synthesis method, based on descriptor analysis of any number of existing or live-recorded sounds, and synthesis by selection of sound segments from the database matching given sound characteristics. It is well described in the literature, but has been rarely examined for its capacity as a new interface for musical expression. The interesting outcome of such an examination is that the actual instrument is the space of sound characteristics, through which the performer navigates with gestures captured by various input devices. We will take a look at different types of interaction modes and controllers (positional, inertial, audio analysis) and the gestures they afford, and provide a critical assessment of their musical and expressive capabilities, based on several years of musical experience, performing with the CataRT system for real-time CBCS.

Mots clés: corpus-based concatenative synthesis; CataRT; gesture

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Diemo Schwarz. The Sound Space as Musical Instrument: Playing Corpus-Based Concatenative Synthesis. New Interfaces for Musical Expression (NIME), May 2012, Ann Arbour, United States. pp.250-253. ⟨hal-01161442⟩