A joint prosody evaluation of French text-to-speech synthesis systems

Marie-Neige Garcia (1) , Christophe d'Alessandro (2) , Gérard Bailly (3) , Philippe Boula de Mareüil (2) , Michel Morel (4)

1 ELDA - Evaluations and Language resources Distribution Agency
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
3 ICP - Institut de la communication parlée
4 CRISCO - Centre de recherche inter-langues sur la signification en contexte

This paper reports on prosodic evaluation in the framework of the EVALDA/EvaSy project for text-to-speech (TTS) evaluation for the French language. Prosody is evaluated using a prosodic transplantation paradigm. Intonation contours generated by the synthesis systems are transplanted on a common segmental content. Both diphone based synthesis and natural speech are used. Five TTS systems are tested along with natural voice. The test is a paired preference test (with 19 subjects), using 7 sentences. The results indicate that natural speech obtains consistently the first rank (with an average preference rate of 80%) , followed by a selection based system (72%) and a diphone based system (58%). However, rather large variations in judgements are observed among subjects and sentences, and in some cases synthetic speech is preferred to natural speech. These results show the remarkable improvement achieved by the best selection based synthesis systems in terms of prosody. In this way; a new paradigm for evaluation of the prosodic component of TTS systems has been successfully demonstrated.

Mots clés: Text-to-speech; Prosody; Evaluation; Prosodic transplantation; Text-to-speech synthesis

Domaines: Linguistique

Marie-Neige Garcia, Christophe d'Alessandro, Gérard Bailly, Philippe Boula de Mareüil, Michel Morel. A joint prosody evaluation of French text-to-speech synthesis systems. 5th edition of the International Conference on Language Ressources and Evaluation (LREC 2006), May 2006, Genoa, Italy. pp.307-310. ⟨hal-00103557⟩