Animating virtual speakers or singers from audio: lip-synching facial animation

Sascha Fagel (1) , Gérard Bailly (2) , Barry-John Theobald (3)

1 ISC-TUB - Institute for Speech and Communication
2 GIPSA-MPACIF - GIPSA - Machines Parlantes, Agents Communicants & Interaction Face-à-face
3 Department of Computer Science

The aim of this special issue is to provide a detailed description of state-of-the-art systems for animating faces during speech, and identify new techniques that have recently emerged from both the audiovisual speech and computer graphics research communities. This special issue is a followup to the first LIPS Visual Speech Synthesis Challenge held as a special session at INTERSPEECH 2008 in Brisbane, Australia. As a motivation for the present special issue, we will report on the LIPS Challenge with respect to the synthesis techniques, andmore importantly the methods and results of the subjective evaluation.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Sascha Fagel, Gérard Bailly, Barry-John Theobald. Animating virtual speakers or singers from audio: lip-synching facial animation. EURASIP Journal on Audio, Speech, and Music Processing, 2009, pp.ID 826091. ⟨10.1155/2009/826091⟩. ⟨hal-00473027⟩