How to predict the global instantaneous feeling induced by a facial picture?

Arnaud Lienhard 1 Patricia Ladret 1 Alice Caplier 1
1 GIPSA-AGPIG - AGPIG
GIPSA-DIS - Département Images et Signal
Abstract : Picture selection is a time-consuming task for humans and a real challenge for machines, which have to retrieve complex and subjective information from image pixels. An automated system that infers human feelings from digital portraits would be of great help for profile picture selection, photo album creation or photo editing. In this work, two models of facial pictures evaluation are defined. The first one predicts the overall aesthetic quality of a facial image, and the second one answers the question " Among a set of facial pictures of a given person, on which picture does the person look like the most friendly? ". Aesthetic quality is evaluated by the computation of 15 features that encode low-level statistics in different image regions (face, eyes, mouth). Relevant features are automatically selected by a feature ranking technique, and the outputs of 4 learning algorithms are fused in order to make a robust and accurate prediction of the image quality. Results are compared with recent works and the proposed algorithm obtains the best performance. The same pipeline is considered to evaluate the likability of a facial picture, with the difference that the estimation is based on high-level attributes such as gender, age, smile. Performance of these attributes is compared with previous techniques that mostly rely on facial keypoints positions, and it is shown that it is possible to obtain likability predictions that are close to human perception. Finally, a combination of both models that selects a likable facial image of good quality for a given person is described.
Document type :
Journal articles
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01198718
Contributor : Arnaud Lienhard <>
Submitted on : Monday, September 14, 2015 - 11:48:04 AM
Last modification on : Wednesday, June 26, 2019 - 10:27:19 AM
Long-term archiving on : Tuesday, December 29, 2015 - 1:33:13 AM

File

Lienhard_Elsevier2015.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Arnaud Lienhard, Patricia Ladret, Alice Caplier. How to predict the global instantaneous feeling induced by a facial picture?. Signal Processing: Image Communication, Elsevier, 2015, 39 (part C), pp.473-486. ⟨10.1016/j.image.2015.04.002⟩. ⟨hal-01198718⟩

Share

Metrics

Record views

298

Files downloads

231