Multilinear Autoencoder for 3D Face Model Learning

Victoria Fernández Abrevaya 1 Stefanie Wuhrer 1 Edmond Boyer 1
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Generative models have proved to be useful tools to represent 3D human faces and their statistical variations. With the increase of 3D scan databases available for training, a growing challenge lies in the ability to learn generative face models that effectively encode shape variations with respect to desired attributes, such as identity and expression, given datasets that can be diverse. This paper addresses this challenge by proposing a framework that learns a generative 3D face model using an autoencoder architecture, allowing hence for weakly supervised training. The main contribution is to combine a convolutional neural network-based en-coder with a multilinear model-based decoder, taking therefore advantage of both the convolutional network robust-ness to corrupted and incomplete data, and of the multilin-ear model capacity to effectively model and decouple shape variations. Given a set of 3D face scans with annotation labels for the desired attributes, e.g. identities and expressions, our method learns an expressive multilinear model that decouples shape changes due to the different factors. Experimental results demonstrate that the proposed method outperforms recent approaches when learning multilinear face models from incomplete training data, particularly in terms of space decoupling, and that it is capable of learning from an order of magnitude more data than previous methods.
Type de document :
Communication dans un congrès
WACV 2018 - IEEE Winter Conference on Applications of Computer Vision, Mar 2018, Lake Tahoe, NV/CA, United States. pp.1-9, 〈〉
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger
Contributeur : Victoria Fernandez Abrevaya <>
Soumis le : lundi 5 février 2018 - 14:00:31
Dernière modification le : mercredi 11 avril 2018 - 01:58:55


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01700934, version 1



Victoria Fernández Abrevaya, Stefanie Wuhrer, Edmond Boyer. Multilinear Autoencoder for 3D Face Model Learning. WACV 2018 - IEEE Winter Conference on Applications of Computer Vision, Mar 2018, Lake Tahoe, NV/CA, United States. pp.1-9, 〈〉. 〈hal-01700934〉



Consultations de la notice


Téléchargements de fichiers