Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Neural Vocoding for Singing and Speaking Voices with the Multi-Band Excited WaveNet

Axel Roebel 1 Frederik Bous 1 
1 Analyse et synthèse sonores [Paris]
STMS - Sciences et Technologies de la Musique et du Son
Abstract : The use of the mel spectrogram as a signal parameterization for voice generation is quite recent and linked to the development of neural vocoders. These are deep neural networks that allow reconstructing high-quality speech from a given mel spectrogram. While initially developed for speech synthesis, now neural vocoders have also been studied in the context of voice attribute manipulation, opening new means for voice processing in audio production. However, to be able to apply neural vocoders in real-world applications, two problems need to be addressed: (1) To support use in professional audio workstations, the computational complexity should be small, (2) the vocoder needs to support a large variety of speakers, differences in voice qualities, and a wide range of intensities potentially encountered during audio production. In this context, the present study will provide a detailed description of the Multi-band Excited WaveNet, a fully convolutional neural vocoder built around signal processing blocks. It will evaluate the performance of the vocoder when trained on a variety of multi-speaker and multi-singer databases, including an experimental evaluation of the neural vocoder trained on speech and singing voices. Addressing the problem of intensity variation, the study will introduce a new adaptive signal normalization scheme that allows for robust compensation for dynamic and static gain variations. Evaluations are performed using objective measures and a number of perceptual tests including different neural vocoder algorithms known from the literature. The results confirm that the proposed vocoder compares favorably to the state-of-the-art in its capacity to generalize to unseen voices and voice qualities. The remaining challenges will be discussed.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03599076
Contributor : Axel Roebel Connect in order to contact the contributor
Submitted on : Sunday, March 6, 2022 - 4:46:47 PM
Last modification on : Tuesday, March 15, 2022 - 3:22:44 AM

Links full text

Identifiers

Citation

Axel Roebel, Frederik Bous. Neural Vocoding for Singing and Speaking Voices with the Multi-Band Excited WaveNet. Information, MDPI, 2022, 13 (3), pp.103. ⟨10.3390/info13030103⟩. ⟨hal-03599076⟩

Share

Metrics

Record views

38