Multiview Semi-Supervised Ranking for Automatic Image Annotation

Abstract : Most photo sharing sites give their users the opportunity to manually label images. The labels collected that way are usually very incomplete due to the size of the image collections: most images are not labeled according to all the categories they belong to, and, conversely, many class have relatively few representative examples. Automated image systems that can deal with small amounts of labeled examples and unbalanced classes are thus necessary to better organize and annotate images. In this work, we propose a multiview semi-supervised bipartite ranking model which allows to leverage the information contained in unlabeled sets of images in order to improve the prediction performance, using multiple descriptions, or views of images. For each topic class, our approach first learns as many view-specific rankers as available views using the labeled data only. These rankers are then improved iteratively by adding pseudo-labeled pairs of examples on which all view-specific rankers agree over the ranking of examples within these pairs. We report on experiments carried out on the NUS-WIDE dataset, which show that the multiview ranking process improves predictive performances when a small number of labeled examples is available specially for unbalanced classes. We show also that our approach achieves significant improvements over a state-of the art semi-supervised multiview classification model.
Type de document :
Communication dans un congrès
ACM International Conference on Multimedia, Oct 2013, Barcelone, Spain. ACM, pp.513-516, 2013, <10.1145/2502081.2502136>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00881259
Contributeur : Massih-Reza Amini <>
Soumis le : jeudi 7 novembre 2013 - 20:15:35
Dernière modification le : jeudi 11 août 2016 - 01:04:41
Document(s) archivé(s) le : lundi 10 février 2014 - 11:46:14

Fichier

MultViewRnk_MM2013.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

LIG | UPMC | LIP6 | UGA

Citation

Ali Fakeri-Tabrizi, Massih-Reza Amini, Patrick Gallinari. Multiview Semi-Supervised Ranking for Automatic Image Annotation. ACM International Conference on Multimedia, Oct 2013, Barcelone, Spain. ACM, pp.513-516, 2013, <10.1145/2502081.2502136>. <hal-00881259>

Partager

Métriques

Consultations de
la notice

289

Téléchargements du document

137