Impact of the face registration techniques on facial expressions recognition

B. Allaert (1) , J. Mennesson (1) , Ioan Marius Bilasco (2, 3, 1) , C. Djeraba (1)

1 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 Université de Lille, Sciences et Technologies
3 LIFL - FOX MIIRE

Recent methodologies for facial expression recognition have been proposed and have obtained good results in near-frontal view. However, these situations do not fairly represent in-the-wild challenges, where expressions are natural and the subject is free of its movement. This is reflected in the accuracy drop of facial expression methods obtained on recent databases. Two challenges (head pose variations and large displacements) in facial expression recognition are studied in this paper. Experiments are proposed in order to quantify the impact of free head movements using representative expression recognition approaches (LBP, LBP-TOP, HOOF). We propose an experimental protocol (SNaP-2DFe) that records, under controlled light, facial expressions with two cameras: one attached on the head and one placed in front of the subject. As in both cameras facial expressions are the same, differences in performances measured on each camera show the impact of head pose variations and large displacements on the underlying recognition approach.

Mots clés: Large displacements; Facial expressions; Head pose variations

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

B. Allaert, J. Mennesson, Ioan Marius Bilasco, C. Djeraba. Impact of the face registration techniques on facial expressions recognition. Signal Processing: Image Communication, 2018, 61, pp.44-53. ⟨10.1016/j.image.2017.11.002⟩. ⟨hal-01644769v2⟩