A Unified Probabilistic Framework for Automatic 3D Facial Expression Analysis based on a Bayesian Belief Inference and Statistical Feature Models

Xi Zhao 1 Emmanuel Dellandréa 1 Jianhua Zou Liming Chen 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Textured 3D face models capture precise facial surfaces along with the associated textures, making it possible for an accurate description of facial activities. In this paper, we present a unified probabilistic framework based on a novel Bayesian Belief Network (BBN) for 3D facial expression and Action Unit (AU) recognition. The proposed BBN performs Bayesian inference based on Statistical Feature Models (SFM) and Gibbs-Boltzmann distribution and feature a hybrid approach in fusing both geometric and appearance features along with morphological ones. When combined with our previously developed morphable partial face model (SFAM), the proposed BBN has the capacity of conducting fully automatic facial expression analysis. We conducted extensive experiments on the two public databases, namely the BU-3DFE dataset and the Bosphorus dataset. When using manually labeled landmarks, the proposed framework achieved an average recognition rate of 94.2% and 85.6% for the 7 and 16 AU on face data from the Bosphorus dataset respectively, and 89.2% for the six universal expressions on the BU-3DFE dataset. Using the landmarks automatically located by SFAM, the proposed BBN still achieved an average recognition rate of 84.9% for the six prototypical facial expressions. These experimental results demonstrate the effectiveness of the proposed approach and its robustness in landmark localization errors.
Type de document :
Article dans une revue
Image and Vision Computing, 2013, 3, 31, pp.231-245. <10.1016/j.imavis.2012.10.001>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01339135
Contributeur : Équipe Gestionnaire Des Publications Si Liris <>
Soumis le : mercredi 29 juin 2016 - 15:46:09
Dernière modification le : jeudi 30 juin 2016 - 01:04:38

Identifiants

Collections

Citation

Xi Zhao, Emmanuel Dellandréa, Jianhua Zou, Liming Chen. A Unified Probabilistic Framework for Automatic 3D Facial Expression Analysis based on a Bayesian Belief Inference and Statistical Feature Models. Image and Vision Computing, 2013, 3, 31, pp.231-245. <10.1016/j.imavis.2012.10.001>. <hal-01339135>

Partager

Métriques

Consultations de la notice

68