Feature points based facial animation retargeting

Ludovic Dutreve 1 Alexandre Meyer 1 Saida Bouakaz 1
1 SAARA - Simulation, Analyse et Animation pour la Réalité Augmentée
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Figure 1: The bottom row shows the virtual face animated by retargeting expressions from the source face (top row). Abstract We present a method for transferring facial animation in real-time. The source animation may be an existing 3D animation or 2D data providing by a video tracker or a motion capture system. Based on two sets of feature points manually selected on the source and target faces (the only manual work required), a RBF network is trained and provides a geometric transformation between the two faces. At each frame, the RBF transformation is applied on the new feature points positions of the source face, resulting in new positions for target feature points according with the expression of the source face and the morphology of the target face. According to their displacements along time, we deform the target mesh on the GPU with the linear blend skinning (LBS) method. In order to make our approach attractive to novice user, we propose a procedural technique to automatically rig the target face by generating vertices weights for the skinning deformation. To summarize, our method provides interactive expression transfer with a minimal human intervention during setup and accepts various kind of animation sources.
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01494990
Contributor : Alexandre Meyer <>
Submitted on : Friday, March 24, 2017 - 1:03:06 PM
Last modification on : Tuesday, February 26, 2019 - 3:37:55 PM
Long-term archiving on : Sunday, June 25, 2017 - 1:16:56 PM

File

Liris-3546.pdf
Files produced by the author(s)

Identifiers

Citation

Ludovic Dutreve, Alexandre Meyer, Saida Bouakaz. Feature points based facial animation retargeting. Symposium on Virtual reality software and technology (VRST), 2008, Bordeaux, France. pp.197 - 197, ⟨10.1145/1450579.1450621⟩. ⟨hal-01494990⟩

Share

Metrics

Record views

198

Files downloads

366