Micro and macro facial expression recognition using advanced Local Motion Patterns

Benjamin Allaert (1) , Ioan Marius Bilasco (1, 2, 3) , Chaabane Djeraba (1)

1 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 LIFL - FOX MIIRE
3 Université de Lille

In this paper, we develop a new method that recognizes facial expressions, on the basis of an innovative Local Motion Patterns (LMP) feature. The LMP feature analyzes locally the motion distribution in order to separate consistent mouvement patterns from noise. Indeed, facial motion extracted from the face is generally noisy and without specific processing, it can hardly cope with expression recognition requirements especially for micro-expressions. Direction and magnitude statistical profiles are jointly analyzed in order to filter out noise. This work presents three main contributions. The first one is the analysis of the face skin temporal elasticity and face deformations during expression. The second one is a unified approach for both macro and micro expression recognition leading the way to supporting a wide range of expression intensities. The third one is the step forward towards in-the-wild expression recognition, dealing with challenges such as various intensity and various expression activation patterns, illumination variations and small head pose variations. Our method outperforms state-of-the-art methods for micro expression recognition and positions itself among top-ranked state-of-the-art methods for macro expression recognition.

Mots clés: Macro expression; Micro expression; Optical flow; Facial expression; Local motion patterns

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Benjamin Allaert, Ioan Marius Bilasco, Chaabane Djeraba. Micro and macro facial expression recognition using advanced Local Motion Patterns. IEEE Transactions on Affective Computing, 2019, ⟨10.1109/TAFFC.2019.2949559⟩. ⟨hal-02428528⟩