Towards Pose-free Tracking of Non-rigid Face using Synthetic Data

Abstract : The non-rigid face tracking has been achieved many advances in recent years, but most of empirical experiments are restricted at near-frontal face. This report introduces a robust framework for pose-free tracking of non-rigid face. Our method consists of two phases: training and tracking. In the training phase, a large offline synthesized database is built to train landmark appearance models using linear Support Vector Machine (SVM). In the tracking phase, a two-step approach is proposed: the first step, namely initialization, benefits 2D SIFT matching between the current frame and a set of adaptive keyframes to estimate the rigid parameters. The second step obtains the whole set of parameters (rigid and non-rigid) using a heuristic method via pose-wise SVMs. The combination of these aspects makes our method work robustly up to 90 degree of vertical axial rotation. Moreover, our method appears to be robust even in the presence of fast movements and tracking losses. Comparing to other published algorithms, our method offers a very good compromise of rigid and non-rigid parameter accuracies. This study gives a promising perspective because of the good results in terms of pose estimation (average error is less than 4 o on BUFT dataset) and landmark tracking precision (5.8 pixel error compared to 6.8 of one state-of-the-art method on Talking Face video). These results highlight the potential of using synthetic data to track non-rigid face in unconstrained poses.
Complete list of metadatas

Cited literature [37 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01166778
Contributor : Ngoc Trung Tran <>
Submitted on : Tuesday, June 23, 2015 - 11:01:00 AM
Last modification on : Monday, October 28, 2019 - 10:50:21 AM
Long-term archiving on: Tuesday, September 15, 2015 - 9:40:12 PM

File

icpram2015.pdf
Files produced by the author(s)

Identifiers

Citation

Ngoc-Trung Tran, Fakhreddine Ababsa, Maurice Charbit. Towards Pose-free Tracking of Non-rigid Face using Synthetic Data. 2015 International Conference on Pattern Recognition Applications and Methods (ICPRAM 2015), Jan 2015, Lisbon, Portugal. ⟨10.5220/0005179300370044⟩. ⟨hal-01166778⟩

Share

Metrics

Record views

532

Files downloads

361