Fully automated facial picture evaluation using high level attributes

Arnaud Lienhard 1 Alice Caplier 1 Patricia Ladret 1
1 GIPSA-AGPIG - AGPIG
GIPSA-DIS - Département Images et Signal
Abstract : People automatically and quickly judge a facial picture from its appearance. Thus, developing tools that can reproduce human judgments may help consumers in their picture selection process. Previous work mostly studied the position of facial keypoints to make predictions about specific traits: trustworthiness, likability, competence, etc. In this work, high level attributes (e.g. gender, age, smile) are automatically extracted using 3 different tools and are used to build models adapted to each trait. Models are validated on a set of synthetic images and it is shown that using attributes increases significantly the correlation between human and algorithmic evaluations. Then, a new dataset of 140 images is presented and used to demonstrate the relevance of high level attributes for evaluating faces with respect to likability and competence. A model combining both facial keypoints and attributes is finally proposed and applied to picture selection: which picture depicts the most likable face for a given person?
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01198699
Contributor : Arnaud Lienhard <>
Submitted on : Monday, September 14, 2015 - 11:35:58 AM
Last modification on : Monday, July 8, 2019 - 3:10:04 PM
Long-term archiving on : Tuesday, December 29, 2015 - 1:31:07 AM

File

Lienhard_FG2015.pdf
Files produced by the author(s)

Identifiers

Citation

Arnaud Lienhard, Alice Caplier, Patricia Ladret. Fully automated facial picture evaluation using high level attributes. 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) , May 2015, Ljubjana, Slovenia. ⟨10.1109/FG.2015.7163114⟩. ⟨hal-01198699⟩

Share

Metrics

Record views

379

Files downloads

344