First Steps in Relaxed Real-Time Typo-Morphological Audio Analysis/Synthesis

Norbert Schnell (1) , Marco Antonio Suarez-Cifuentes (1) , Jean-Philippe Lambert (1)

1 Equipe Interactions musicales temps-réel

This paper describes a real-time audio analysis/resynthesis system that we developed for a music piece for ensemble and electronics. The system combines real-time audio analysis and concatenative synthesis based on the segmentation of sound streams into constituting segments and the description of segments by an efficient set of descriptors adapted to the given musical context. The system has been implemented in Max/MSP using the FTM & Co and MuBu libraries and successfully employed in the production and performance of the piece. As more and more research in the domain of music information retrieval, we use the term of typo-morhpology to designate the description of sounds by morphologic criteria including the temporal evolution of sound features that also can provide pertinent means for the classification of sounds. Although, the article mainly insists on the technical aspects of the work, it occasionally contextualizes the different technical choices regarding particular musical aspects.

Mots clés: synthesis; Real-time; Sound Analysis; concatenative synthesis; audio mosaicing; typo-morphology

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Norbert Schnell, Marco Antonio Suarez-Cifuentes, Jean-Philippe Lambert. First Steps in Relaxed Real-Time Typo-Morphological Audio Analysis/Synthesis. Sound and Music Computing, 2010, Barcelone, Spain. pp.1-1. ⟨hal-01161265⟩