3D face pose and animation tracking via eigen-decomposition based Bayesian approach

Ngoc-Trung Tran 1, 2 Fakhr-Eddine Ababsa 3 Maurice Charbit 1, 2 Jacques Feldmar 1 Dijana Petrovska-Delacrétaz 4 Gérard Chollet 1, 2
1 LTCI - Laboratoire Traitement et Communication de l'Information
2 TSI - Département Traitement du Signal et des Images
3 IBISC - Informatique, Biologie Intégrative et Systèmes Complexes
4 SAMOVAR - Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux
Abstract : This paper presents a new method to track both the face pose and the face animation with a monocular camera. The approach is based on the 3D face model CANDIDE and on the SIFT (Scale Invariant Feature Transform) descriptors, extracted around a few given landmarks (26 selected vertices of CANDIDE model) with a Bayesian approach. The training phase is performed on a synthetic database generated from the first video frame. At each current frame, the face pose and animation parameters are estimated via a Bayesian approach, with a Gaussian prior and a Gaussian likelihood function whose the mean and the covariance matrix eigenvalues are updated from the previous frame using eigen decomposition. Numerical results on pose estimation and landmark locations are reported using the Boston University Face Tracking (BUFT) database and Talking Face video. They show that our approach, compared to six other published algorithms, provides a very good compromise and presents a promising perspective due to the good results in terms of landmark localization.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-00915902
Contributor : Frédéric Davesne <>
Submitted on : Tuesday, March 18, 2014 - 3:45:58 PM
Last modification on : Wednesday, December 18, 2019 - 5:29:23 PM
Long-term archiving on: Wednesday, June 18, 2014 - 10:37:15 AM

File

inproceedings-2013-13031-6.pdf
Files produced by the author(s)

Identifiers

Collections

IBISC | IBISC-IRA2 | CNRS | UNIV-EVRY | PARISTECH | TELECOM-SUDPARIS | INSTITUT-TELECOM | IDS | LTCI

Citation

Ngoc-Trung Tran, Fakhr-Eddine Ababsa, Maurice Charbit, Jacques Feldmar, Dijana Petrovska-Delacrétaz, et al.. 3D face pose and animation tracking via eigen-decomposition based Bayesian approach. 9th International Symposium on Advances in Visual Computing (ISVC 2013), Jul 2013, Rethymnon, Crete, Greece. pp.562--571, ⟨10.1007/978-3-642-41914-0_55⟩. ⟨hal-00915902⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

477

Files downloads

249

Contact

Informations

CCSD