Skip to Main content Skip to Navigation
Conference papers

Towards eyegaze-aware analysis and synthesis of audiovisual speech

Frédéric Elisei 1 Gérard Bailly 2 Alix Casari 2 Stephan Raidt 2
1 GIPSA-Services - GIPSA-Services
GIPSA-lab - Grenoble Images Parole Signal Automatique
Abstract : Eye gaze plays many important roles in audiovisual speech, especially in face-to-face interactions. Eyelid shapes are known to correlate with gaze direction. This correlation is perceived and should be restored when animating 3D talking heads. This paper presents a data-based construction method that models the user's eyelid geometric deformations caused by gazing and blinking during conversation. This 3D eyelid and gaze model has been used to analyze and automatically reconstruct our German speaker's gaze. This can potentially complement or replace infra-red based eye tracking when it is important to collect not only where the user looks but also how (ocular expressions...). This method may be used as a tool to study expressive speech and gaze patterns related to cognitive activities (speaking, listening, thinking...).
Complete list of metadatas
Contributor : Gérard Bailly <>
Submitted on : Tuesday, September 4, 2007 - 1:08:55 PM
Last modification on : Wednesday, May 13, 2020 - 4:22:02 PM
Document(s) archivé(s) le : Friday, April 9, 2010 - 1:32:28 AM


Files produced by the author(s)


  • HAL Id : hal-00169556, version 1


Frédéric Elisei, Gérard Bailly, Alix Casari, Stephan Raidt. Towards eyegaze-aware analysis and synthesis of audiovisual speech. International Conference on Auditory-Visual Speech Processing (AVSP 2007), Aug 2007, Hilvarenbeek, Netherlands. pp.50-56. ⟨hal-00169556⟩



Record views


Files downloads