Statistical Conversion of Silent Articulation into Audible Speech using Full-Covariance HMM

Thomas Hueber 1 Gérard Bailly 1
1 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
Abstract : This article investigates the use of statistical mapping techniques for the conversion of articulatory movements into audible speech with no restriction on the vocabulary, in the context of a silent speech interface driven by ultrasound and video imaging. As a baseline, we first evaluated the GMM-based mapping considering dynamic features, proposed by Toda et al. (2007) for voice conversion. Then, we proposed a ‘phonetically-informed’ version of this technique, based on full-covariance HMM. This approach aims (1) at modeling explicitly the articulatory timing for each phonetic class, and (2) at exploiting linguistic knowledge to regularize the problem of silent speech conversion. Both techniques were compared on continuous speech, for two French speakers (one male, one female). For modal speech, the HMM-based technique showed a lower spectral distortion (objective evaluation). However, perceptual tests (transcription and XAB discrimination tests) showed a better intelligibility of the GMM-based technique, probably related to its less fluctuant quality. For silent speech, a perceptual identification test revealed a better segmental intelligibility for the HMM-based technique on consonants.
Type de document :
Article dans une revue
Computer Speech and Language, Elsevier, 2016, 36, pp.274-293. 〈10.1016/j.csl.2015.03.005〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01228885
Contributeur : Gérard Bailly <>
Soumis le : samedi 14 novembre 2015 - 13:15:21
Dernière modification le : lundi 29 février 2016 - 12:19:29

Identifiants

Collections

Citation

Thomas Hueber, Gérard Bailly. Statistical Conversion of Silent Articulation into Audible Speech using Full-Covariance HMM. Computer Speech and Language, Elsevier, 2016, 36, pp.274-293. 〈10.1016/j.csl.2015.03.005〉. 〈hal-01228885〉

Partager

Métriques

Consultations de la notice

166