Skip to Main content Skip to Navigation
Journal articles

Saliency Based Framework for Facial Expression Recognition

Abstract : This article proposes a novel framework for the recognition of six universal facial expressions. The framework is based on three set of features extracted from the face image: entropy, brightness and local binary pattern. First, saliency maps are obtained by state-of-the-art saliency detection algorithm i.e. “frequency-tuned salient region detection”. The idea is to use saliency maps to find appropriate weights or values for extracted features (i.e. brightness and entropy). To validate the performance of saliency detection algorithm against human visual system, we have performed a visual experiment. Eye movements of 15 subjects were recorded with an eye-tracker in free viewing conditions as they watch a collection of 54 videos selected from Cohn-Kanade facial expression database. Results of the visual experiment provided the evidence that obtained saliency maps conforms well with human fixations data. Finally, evidence of the proposed framework’s performance is exhibited through satisfactory classification results on Cohn-Kanade database, FG-NET FEED database and Dartmouth database of children’s faces.
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download
Contributor : Alexandre Meyer <>
Submitted on : Friday, June 23, 2017 - 3:09:43 PM
Last modification on : Wednesday, July 8, 2020 - 12:43:51 PM
Long-term archiving on: : Wednesday, January 10, 2018 - 10:36:56 PM


Saliency Based Framework for F...
Files produced by the author(s)



Rizwan Ahmed Khan, Alexandre Meyer, Hubert Konik, Saïda Bouakaz. Saliency Based Framework for Facial Expression Recognition. Frontiers of Computer Science, Springer Verlag, 2017, ⟨10.1007/s11704-017-6114-9⟩. ⟨hal-01546192⟩



Record views


Files downloads