Realistic and animatable face models for expression simulations in 3D

Nesli Erdogmus (1) , Jean-Luc Dugelay (1)

1 Eurecom [Sophia Antipolis]

In the face recognition problem, one of the most critical sources of variation is facial expression. This paper presents a system to overcome this issue by utilizing facial expression simulations on realistic and animatable face models that are in compliance with MPEG-4 specifications. In our system, firstly, 3D frontal face scans of the users in neutral expression and with closed mouth are taken for one-time enrollment. Those rigid face models are then converted into animatable models by warping a generic animatable model using Thin Plate Spline method. The warping is based on the facial feature points and both 2D color and 3D shape data are exploited for the automation of their extraction. The obtained models of the users can be animated by using a facial animation engine. This new attribution helps us to bring our whole database in the same "expression state" detected in a test image for better recognition results, since the disadvantage of expression variations is eliminated.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Nesli Erdogmus, Jean-Luc Dugelay. Realistic and animatable face models for expression simulations in 3D. SPIE Electronic Imaging Conference on 3D Image Processing and Applications, 3DIP 2010, Jan 2010, San Jose, United States. pp.1. ⟨hal-00782227⟩