Spatializing Timbre with Corpus-Based Concatenative Synthesis

Aaron Einbond (1, 2) , Diemo Schwarz (1, 2)

1 Equipe Autre (hors R&D)
2 Equipe Interactions musicales temps-réel

Corpus-based concatenative synthesis presents unique possibilities for the visualization of audio descriptor data. These visualization tools can be applied to sound diffusion in the physical space of the concert hall using current spatialization technologies. Using CataRT and the FTM library for Max/MSP we develop a technique for the organization of a navigation space for synthesis based on user-defined spatial zones and informed by the perceptual concept of timbre space. Spatialization responds automatically to descriptor data and is controllable in real-time or can be recorded for later playback. This work has been realized in recent compositions for instruments, electronics, and sound installation using Wave Field Synthesis and Vector-Based Amplitude Panning. The goal is to place the listener in the midst of a virtual space of sounds organized by their descriptor data, simulating an immersion in timbre space.

Mots clés: timbre space; audio descriptors; Spatialization; concatenative synthesis; Wave Field Synthesis; CataRT; Max/MSP; corpus-based

Mots clés: Informatique musicale

Domaines: Informatique [cs]; Son [cs.SD]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]; Musique, musicologie et arts de la scène; Interface homme-machine [cs.HC]; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]

Aaron Einbond, Diemo Schwarz. Spatializing Timbre with Corpus-Based Concatenative Synthesis. International Computer Music Conference (ICMC), Jun 2010, New York, United States. pp.1-1. ⟨hal-01161253⟩