A multi-layer F0 model for singing voice synthesis using a B-spline representation with intuitive controls

Luc Ardaillon (1, 2) , Gilles Degottex (1, 2) , Axel Roebel (1, 2)

1 Analyse et synthèse sonores [Paris]
2 STMS - Sciences et Technologies de la Musique et du Son

In singing voice, the fundamental frequency (F0) carries not only melody, but also music style, personal expressivity and other characteristics specific to voice production mechanism. The F0 modeling is therefore critical for a natural-sounding and expressive synthesis. In addition, for artistic purposes, composers also need to have control over expressive parameters of the F0 curve, which is missing in many current approaches. This paper presents a novel parametric F0 model for singing voice synthesis with intuitive control of expressive parameters. The proposed approach considers the various F0 variations of the singing voice as separate layers using B-splines to model the melodic component. This model has been implemented in a concatenative singing voice synthesis system and its perceived naturalness has been evaluated through listening tests. The validity of each layer is first evaluated independently, and the full model is then compared to real F0 curves from professional singers. The results of these tests suggest that the model is suitable to produce natural and expressive F0 contours.

Mots clés: concatenative synthesis; F0 model; singing voice synthesis

Domaines: Traitement du signal et de l'image [eess.SP]; Son [cs.SD]

Luc Ardaillon, Gilles Degottex, Axel Roebel. A multi-layer F0 model for singing voice synthesis using a B-spline representation with intuitive controls. Interspeech 2015, Sep 2015, Dresden, Germany. ⟨hal-01251898v2⟩