State of the Art in Sound Texture Synthesis

Diemo Schwarz (1, 2)

1 Equipe Interactions musicales temps-réel
2 Equipe Autre (hors R&D)

The synthesis of sound textures, such as rain, wind, or crowds, is an important application for cinema, multimedia creation, games and installations. However, despite the clearly defined requirements of naturalness and flexibility, no automatic method has yet found widespread use. After clarifying the definition, terminology, and usages of sound texture synthesis, we will give an overview of the many existing methods and approaches, and the few available software implementations, and classify them by the synthesis model they are based on, such as subtractive or additive synthesis, granular synthesis, corpus-based concatenative synthesis, wavelets, or physical modeling. Additionally, an overview is given over analysis methods used for sound texture synthesis, such as segmentation, statistical modeling, timbral analysis, and modeling of transitions.

Mots clés: statistical modeling; concatenative synthesis; granular synthesis; subtractive synthesis; Wavelets; sound textures; audio descriptors; corpus-based synthesis; physical modeling; additive synthesis

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]; Musique, musicologie et arts de la scène; Informatique [cs]; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Diemo Schwarz. State of the Art in Sound Texture Synthesis. Digital Audio Effects (DAFx), Sep 2011, Paris, France. pp.221-232. ⟨hal-01161296⟩