Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation

Abstract : Head pose estimation is a challenging computer vision problem with important applications in different scenarios such as human-computer interaction or face recognition. In this paper, we present a 3D head pose estimation algorithm based on non-linear manifold learning. A key feature of the proposed approach is that it allows modeling the underlying 3D manifold that results from the combination of rotation angles. To do so, we use tensor decomposition to generate separate subspaces for each variation factor and show that each of them has a clear structure that can be modeled with cosine functions from a unique shared parameter per angle. Such representation provides a deep understanding of data behavior. We show that the proposed framework can be applied to a wide variety of input features and can be used for different purposes. Firstly, we test our system on a publicly available database, which consists of 2D images and we show that the cosine functions can be used to synthesize rotated versions from an object from which we see only a 2D image at a specific angle. Further, we perform 3D head pose estimation experiments using other two types of features: automatic landmarks and histogram-based 3D descriptors. We evaluate our approach on two publicly available databases, and demonstrate that angle estimations can be performed by optimizing the combination of these cosine functions to achieve state-of-the-art performance.
Complete list of metadatas

Cited literature [71 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02267568
Contributor : Adrià Ruiz <>
Submitted on : Monday, August 19, 2019 - 2:33:10 PM
Last modification on : Monday, August 26, 2019 - 9:08:32 AM

File

3DHeapPose_IJCV2019.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Dmytro Derkach, Adrià Ruiz, Federico Sukno. Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation. International Journal of Computer Vision, Springer Verlag, In press, ⟨10.1007/s11263-019-01208-x⟩. ⟨hal-02267568⟩

Share

Metrics

Record views

42

Files downloads

35