Timbre latent space: exploration and creative aspects - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Timbre latent space: exploration and creative aspects

Résumé

Recent studies show the ability of unsupervised models to learn invertible audio representations using Auto-Encoders. They enable high-quality sound synthesis but a limited control since the latent spaces do not disentangle timbre properties. The emergence of disentangled representations was studied in Variational Auto-Encoders (VAEs), and has been applied to audio. Using an additional perceptual regularization can align such latent representation with the previously established multi-dimensional timbre spaces, while allowing continuous inference and synthesis. Alternatively, some specific sound attributes can be learned as control variables while unsupervised dimensions account for the remaining features. New possibilities for timbre manipulations are enabled with generative neural networks, although the exploration and the creative use of their representations remain little. The following experiments are led in cooperation with two composers and propose new creative directions to explore latent sound synthesis of musical timbres, using specifically designed interfaces (Max/MSP, Pure Data) or mappings for descriptor-based synthesis.

Dates et versions

hal-03208019 , version 1 (26-04-2021)

Identifiants

Citer

Antoine Caillon, Adrien Bitton, Brice Gatinet, Philippe Esling. Timbre latent space: exploration and creative aspects. Timbre International Conference, Sep 2020, Athenes, Greece. ⟨hal-03208019⟩
40 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More