A study on auditory feature spaces for speech-driven lip animation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

A study on auditory feature spaces for speech-driven lip animation

Résumé

We present in this paper a study on auditory feature spaces for speech-driven face animation. The goal is to provide solid analytic ground to underscore the description capability of some well-known features with relation to lipsync. A set of various audio features describing the temporal and spectral shape of speech signal has been computed on annotated audio extracts. The dimension of the input feature space has been reduced with PCA and the contribution of each input feature is investigated to determine the more descriptive. The resulting feature space is quantitatively and qualitatively analyzed for the description of acoustic units (phonemes, visemes, etc.) and we demonstrate that the use of some low-level features in addition to MFCC increases the relevance of the feature space. Finally, we evaluate the stability of these features w.r.t. the gender of the speaker.
Fichier principal
Vignette du fichier
interspeech_2011.pdf (177.61 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00598314 , version 1 (16-10-2012)

Identifiants

  • HAL Id : inria-00598314 , version 1

Citer

Guylaine Le-Jan, Yannick Benezeth, Guillaume Gravier, Frédéric Bimbot. A study on auditory feature spaces for speech-driven lip animation. Interspeech, Aug 2011, Florence, Italy. ⟨inria-00598314⟩
191 Consultations
179 Téléchargements

Partager

Gmail Facebook X LinkedIn More