Associating textual features with visual ones to improve affective image classification

Ningning Liu 1 Emmanuel Dellandréa 1 Bruno Tellez 1 Liming Chen 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Many images carry a strong emotional semantic. These last years, some rare investigations have been driven to automatically identify induced emotions that may arise in viewers when looking at those images, based on low-level image properties. Since these features can only catch the image atmosphere, they may fail when the emotional semantic is carried by objects in images, such as a child crying for example. Therefore additional information is needed, and we propose in this paper to make use of textual information describing the image such as tags. Thus, we have developed features based on this text to catch its emotional meaning that are further combined with visual features thanks to an approach based on the evidence theory. Experiments have been driven on two datasets to evaluate visual and textual features and their fusion. The results have shown that our textual features can improve the classification accuracy of affective images.
Type de document :
Communication dans un congrès
International Conference on Affective Computing and Intelligent Interaction (ACII2011), Oct 2011, Memphis, TN, United States. Springer, pp.195-204, 2011, <10.1007/978-3-642-24600-5_23>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01354456
Contributeur : Équipe Gestionnaire Des Publications Si Liris <>
Soumis le : jeudi 18 août 2016 - 19:28:19
Dernière modification le : vendredi 19 août 2016 - 01:04:22

Identifiants

Collections

Citation

Ningning Liu, Emmanuel Dellandréa, Bruno Tellez, Liming Chen. Associating textual features with visual ones to improve affective image classification. International Conference on Affective Computing and Intelligent Interaction (ACII2011), Oct 2011, Memphis, TN, United States. Springer, pp.195-204, 2011, <10.1007/978-3-642-24600-5_23>. <hal-01354456>

Partager

Métriques

Consultations de la notice

104