Automatic Analysis of Affective States: Visual Attention Based Approach

Rizwan Ahmed Khan 1 Alexandre Meyer 1 Hubert Konik Saida Bouakaz 1
1 SAARA - Simulation, Analyse et Animation pour la Réalité Augmentée
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Computing environment is moving from computer centered designs to human-centered designs. Human’s tend to communicate wealth of information through affective states or expressions. Thus automatic analysis of user affective states have become inevitable for computer vision community. In this paper first we focus on understanding human visual system (HVS) when it decodes or recognizes facial expressions. To understand HVS, we have conducted psycho-visual experimental study with an eye-tracker, to find which facial region is perceptually more attractive or salient for a particular expression. Secondly, based on results obtained from psycho-visual experimental study we have proposed a novel framework for automatic analysis of affective states. Framework creates discriminative feature space by processing only salient facial regions to extract Pyramid Histogram of Orientation Gradients (PHOG) features. The proposed framework achieved automatic expression recognition accuracy of 95.3 % on extended Cohn-Kanade (CK+) facial expression database for six universal facial expressions. We have also discussed generalization capabilites of proposed framework on unseen data. In the last paper discusses effectiveness of proposed framework against low resolution image sequences.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01314489
Contributor : Équipe Gestionnaire Des Publications Si Liris <>
Submitted on : Wednesday, May 11, 2016 - 2:42:50 PM
Last modification on : Tuesday, February 26, 2019 - 3:37:56 PM

Identifiers

Citation

Rizwan Ahmed Khan, Alexandre Meyer, Hubert Konik, Saida Bouakaz. Automatic Analysis of Affective States: Visual Attention Based Approach. International Multi Topic Conference 2013, Jan 2014, Jamshoro, Pakistan. pp.98-108, ⟨10.1007/978-3-319-10987-9_10⟩. ⟨hal-01314489⟩

Share

Metrics

Record views

121