NON-REAL-TIME TRANSDUCTION AND ITS USE AS A COMPOSITIONAL TECHNIQUE FOR THE CREATION OF VISUAL MUSIC

La transduction dans la création de la musique visuelle en temps différé

Carlos Lopez (1)

1 CICM - Centre de recherche Informatique et Création Musicale

The computer allows us to simulate all sorts of behaviours that go beyond the physical, mechanical and optical possibilities imposed by traditional visual music instruments (Levin, 2000, p.33). Nevertheless, the amount of data and the resolution of the sound and image files an artist can use in real-time to create visual music are limited by the processing capabilities of the computer (or computers) that he works with. Transferring (or, to be more precise, transducing) data between digital representations of sounds, gestures and images is one of the main compositional techniques in today's interactive visual music. This article presents different techniques and software tools that can be useful in establishing transductions between digital sounds, images and control gestures in non-real-time. Three examples of the implementation of these ideas in different contexts will be presented in order to analyze the benefits of this approach. The first example, " Elastic Study " , is an audiovisual piece in which different psychoacoustic characteristics of an acousmatic tape composition are analyzed and used to control a visual 3D particle system in non-real time. A second example, " The Flowers and the Clouds " is a visual music piece in which user's gestures are recorded and used to control a 3D particle system and an ensemble of synthesis sound processes in non-real time. The third and final example is a video in which a non-real time analysis of an HD video is used to control the parameters of a sound synthesis process.

Le coût de traitement computationnel nécessaire pour transférer des données entre le son, le geste et l'image numériques pose des contraintes considérables sur la quantité, la qualité et les processus de manipulation qu’un artiste peut réaliser sur ces matériaux en temps réel. Cet article introduit des techniques et outils logiciels pour établir des transferts de données entre divers espaces de représentation (comme des signaux audio ou vidéo, des bases des données ou des algorithmes génératifs, par exemple) en temps différé. Trois exemples de l’usage des idées présentées sont décrits pour analyser les avantages que cette approche pour la création audiovisuelle.

Domaines: Musique, musicologie et arts de la scène

Carlos Lopez. NON-REAL-TIME TRANSDUCTION AND ITS USE AS A COMPOSITIONAL TECHNIQUE FOR THE CREATION OF VISUAL MUSIC. ICMC - International Computer Music Conference, Aug 2013, Perth, Australia. ⟨hal-01665405⟩