Skip to Main content Skip to Navigation
Journal articles

Fine-grained facial landmark detection exploiting intermediate feature representations

Yongzhe Yan 1, 2 Stefan Duffner 3 Priyanka Phutane 1 Anthony Berthelier 1, 2 Xavier Naturel Christophe Blanc 1, 2 Christophe Garcia 3 Thierry Chateau 1, 2
1 COMSEE - COMputers that SEE
ISPR - Image, système de perception, robotique
3 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Facial landmark detection has been an active research subject over the last decade. In this paper, we present a new approach for Fine-grained Facial Landmark Detection (FFLD) improving on the precision of the detected points. A high spatial precision of facial landmarks is crucial for many applications related to aesthetic rendering, such as face modeling, face animation, virtual make-up, etc. In this paper, we present an approach that improves the detection precision. Since most facial landmarks are positioned on visible boundary lines, we train a model that encourages the detected landmarks to stay on these boundaries. Our proposed Convolutional Neural Networks (CNN) effectively exploits lower-level feature maps containing abundant boundary information. To this end, beside the main CNN predicting facial landmark positions, we use several additional components, called CropNets. CropNet receives patches cropped from feature maps at different stages of this CNN, and estimate fine corrections of its predicted positions. We also introduce a novel robust spatial loss function based on pixel-wise differences between patches cropped from predicted and ground-truth positions. To further improve the landmark localisation, our framework uses several loss functions optimising the precision at several stages in different ways. Extensive experiments show that our framework significantly increases the local precision of state-of-the-art deep coordinate regression models.
Document type :
Journal articles
Complete list of metadata

Cited literature [72 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02890931
Contributor : Yongzhe Yan <>
Submitted on : Monday, July 6, 2020 - 4:15:25 PM
Last modification on : Wednesday, February 24, 2021 - 4:16:03 PM
Long-term archiving on: : Monday, September 28, 2020 - 3:34:30 PM

File

CVIU_Fine_grained_facial_landm...
Files produced by the author(s)

Identifiers

Citation

Yongzhe Yan, Stefan Duffner, Priyanka Phutane, Anthony Berthelier, Xavier Naturel, et al.. Fine-grained facial landmark detection exploiting intermediate feature representations. Computer Vision and Image Understanding, Elsevier, In press, 200, pp.1-14. ⟨10.1016/j.cviu.2020.103036⟩. ⟨hal-02890931⟩

Share

Metrics

Record views

91

Files downloads

256