Corpus-Based Concatenative Synthesis

Diemo Schwarz (1, 2)

1 Equipe Interactions musicales temps-réel
2 Analyse et synthèse sonores [Paris]

Corpus-based concatenative methods for musical sound synthesis have attracted much attention recently. They make use of a variety of sound snippets in a database to assemble a desired sound or phrase according to a target specification given in sound descriptors or by an example sound. With ever-larger sound databases easily available, together with a pertinent description of their contents, they are increasingly used for composition, high-level instrument synthesis, interactive exploration of a sound corpus, and others. This paper gives an overview of the components needed for corpus-based concatenative synthesis, and details of some realisations. Signal processing methods are crucial for all parts of analysis, (segmentation and descriptor analysis), for synthesis, and can intervene in the selection part e.g. for spectral matching.

Mots clés: sound synthesis; Real-time; interaction; concatenative synthesis; data-driven synthesis; unit selection; database; corpus-based synthesis; content-based selection

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Acoustique [physics.class-ph]; Neurosciences; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Diemo Schwarz. Corpus-Based Concatenative Synthesis : Assembling sounds by content-based selection of units from large sound databases. IEEE Signal Processing Magazine, 2007, 24 (2), pp.92-104. ⟨hal-01106298⟩