A Selective Weighted Late Fusion for Visual Concept Recognition

Ningning Liu 1 Emmanuel Dellandréa 1 Chao Zhu 1 Charles-Edmond Bichot 1 Liming Chen 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : We propose in this paper a novel multimodal approach to automatically predict the visual concepts of images through an effective fusion of visual and textual features. It relies on a Selective Weighted Late Fusion (SWLF) scheme which, in optimizing an overall Mean interpolated Average Precision (MiAP), learns to automatically select and weight the best experts for each visual concept to be recognized. Experiments were conducted on the MIR Flickr image collection within the ImageCLEF 2011 Photo Annotation challenge. The results have brought to the fore the effectiveness of SWLF as it achieved a MiAP of 43.69 % for the detection of the 99 visual concepts which ranked 2nd out of the 79 submitted runs, while our new variant of SWLF allows to reach a MiAP of 43.93 %.
Type de document :
Communication dans un congrès
Fusiello, Andrea and Murino, Vittorio and Cucchiara, Rita. ECCV 2012 Workshop on Information Fusion in Computer Vision for Concept Recognition, Oct 2012, Florence, Italy. Springer, pp.426-435, 2012, <10.1007/978-3-642-33885-4_43>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01353059
Contributeur : Équipe Gestionnaire Des Publications Si Liris <>
Soumis le : mercredi 10 août 2016 - 16:20:52
Dernière modification le : jeudi 11 août 2016 - 01:04:18

Identifiants

Collections

Citation

Ningning Liu, Emmanuel Dellandréa, Chao Zhu, Charles-Edmond Bichot, Liming Chen. A Selective Weighted Late Fusion for Visual Concept Recognition. Fusiello, Andrea and Murino, Vittorio and Cucchiara, Rita. ECCV 2012 Workshop on Information Fusion in Computer Vision for Concept Recognition, Oct 2012, Florence, Italy. Springer, pp.426-435, 2012, <10.1007/978-3-642-33885-4_43>. <hal-01353059>

Partager

Métriques

Consultations de la notice

77