Lip Modelling and Segmentation

Alice Caplier 1 Sébastien Stillittano 1 Christian Bouvier 1 Pierre-Yves Coulon 1
GIPSA-DIS - Département Images et Signal
Abstract : Lip segmentation is the first step of any audio-visual speech reading system. The accuracy of this segmentation has a major influence on the performances of the global system. But this is a very difficult task. First of all, lip shape can undergo strong deformations during a speech sequence. As many other image processing algorithms, the segmentation task is also influenced by the illumination conditions and by the orientation of the object to be segmented. In this chapter, we present an overview about lip modeling and lip segmentation (region-based and contour-based methods). We limit our study to the problem of lip segmentation in frontal faces. Section I gives an overview about the chrominance information that is used for lip segmentation and a comparison between different chrominance cues is proposed. Section II presents region-based approaches and training steps. Section III focuses on contour-based approaches and parametric lip models. Section IV inventories methods for lip segmentation accuracy evaluation. Some specific applications are briefly presented in section V.
Complete list of metadatas
Contributor : Alice Caplier <>
Submitted on : Sunday, March 29, 2009 - 3:29:23 PM
Last modification on : Monday, April 9, 2018 - 12:22:45 PM


  • HAL Id : hal-00371560, version 1



Alice Caplier, Sébastien Stillittano, Christian Bouvier, Pierre-Yves Coulon. Lip Modelling and Segmentation. Dr. Alan Wee-Chung Liew (Griffith University, Australia) and Dr. Shilin Wang (Shanghai Jiaotong University, China). Visual Speech Recognition: Lip Segmentation and Mapping, pp.70-127, 2009, ISBN 978-1-60566-186-5. ⟨hal-00371560⟩



Record views