Skip to Main content Skip to Navigation
Conference papers

Towards eyegaze-aware analysis and synthesis of audiovisual speech

Frédéric Elisei 1 Gérard Bailly 2 Alix Casari 2 Stephan Raidt 2
1 GIPSA-Services - GIPSA-Services
GIPSA-lab - Grenoble Images Parole Signal Automatique
Abstract : Eye gaze plays many important roles in audiovisual speech, especially in face-to-face interactions. Eyelid shapes are known to correlate with gaze direction. This correlation is perceived and should be restored when animating 3D talking heads. This paper presents a data-based construction method that models the user's eyelid geometric deformations caused by gazing and blinking during conversation. This 3D eyelid and gaze model has been used to analyze and automatically reconstruct our German speaker's gaze. This can potentially complement or replace infra-red based eye tracking when it is important to collect not only where the user looks but also how (ocular expressions...). This method may be used as a tool to study expressive speech and gaze patterns related to cognitive activities (speaking, listening, thinking...).
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00169556
Contributor : Gérard Bailly <>
Submitted on : Tuesday, September 4, 2007 - 1:08:55 PM
Last modification on : Wednesday, May 13, 2020 - 4:22:02 PM
Document(s) archivé(s) le : Friday, April 9, 2010 - 1:32:28 AM

File

fe_AVSP07.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00169556, version 1

Citation

Frédéric Elisei, Gérard Bailly, Alix Casari, Stephan Raidt. Towards eyegaze-aware analysis and synthesis of audiovisual speech. International Conference on Auditory-Visual Speech Processing (AVSP 2007), Aug 2007, Hilvarenbeek, Netherlands. pp.50-56. ⟨hal-00169556⟩

Share

Metrics

Record views

411

Files downloads

191