Multimodal Approach for Emotion Recognition Using an Algebraic Representation of Emotional States

Abstract : Emotions play a key role in human-computer interaction. They are generally expressed through several ways (e.g. facial expressions, speech, body postures and gestures, etc). In this paper, we present a multimodal approach for the emotion recognition that integrates information coming from different cues and modalities. It is based on a formal multidimensional model using an algebraic representation of emotional states. This multidimensional model provides to represent infinity of emotions and provide powerful mathematical tools for the analysis and the processing of these emotions. It permits to estimate the human emotional state through combining information from different modalities (e.g. facial expressions, speech, body postures and gestures, etc) in order to allow more reliable estimation of emotional states. Our proposal permits to recognize not only the basic emotions (e.g., anger, sadness, fear) but also different types of complex emotions like simulated and masked emotions. Experimental results show how the proposed approach increase the recognition rates in comparison with the unimodal approach.
Type de document :
Communication dans un congrès
IEEE. Eighth International Conference on Signal Image Technology and Internet Based Systems (SITIS), Nov 2012, Naples, Italy. IEEE Xplore, pp.541-546, <http://ieeexplore.ieee.org/document/6395141/>. <10.1109/SITIS.2012.84>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01516370
Contributeur : Nhan Le Thanh <>
Soumis le : dimanche 30 avril 2017 - 17:32:36
Dernière modification le : lundi 1 mai 2017 - 01:05:43

Identifiants

Collections

Citation

Imen Tayari-Meftah, Nhan Le-Thanh, Chokri Ben-Amar. Multimodal Approach for Emotion Recognition Using an Algebraic Representation of Emotional States. IEEE. Eighth International Conference on Signal Image Technology and Internet Based Systems (SITIS), Nov 2012, Naples, Italy. IEEE Xplore, pp.541-546, <http://ieeexplore.ieee.org/document/6395141/>. <10.1109/SITIS.2012.84>. <hal-01516370>

Partager

Métriques

Consultations de la notice

50