Multiview Semi-Supervised Ranking for Automatic Image Annotation

Abstract : Most photo sharing sites give their users the opportunity to manually label images. The labels collected that way are usually very incomplete due to the size of the image collections: most images are not labeled according to all the categories they belong to, and, conversely, many class have relatively few representative examples. Automated image systems that can deal with small amounts of labeled examples and unbalanced classes are thus necessary to better organize and annotate images. In this work, we propose a multiview semi-supervised bipartite ranking model which allows to leverage the information contained in unlabeled sets of images in order to improve the prediction performance, using multiple descriptions, or views of images. For each topic class, our approach first learns as many view-specific rankers as available views using the labeled data only. These rankers are then improved iteratively by adding pseudo-labeled pairs of examples on which all view-specific rankers agree over the ranking of examples within these pairs. We report on experiments carried out on the NUS-WIDE dataset, which show that the multiview ranking process improves predictive performances when a small number of labeled examples is available specially for unbalanced classes. We show also that our approach achieves significant improvements over a state-of the art semi-supervised multiview classification model.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [11 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00881259
Contributor : Massih-Reza Amini <>
Submitted on : Thursday, November 7, 2013 - 8:15:35 PM
Last modification on : Tuesday, April 2, 2019 - 1:47:43 AM
Document(s) archivé(s) le : Monday, February 10, 2014 - 11:46:14 AM

File

MultViewRnk_MM2013.pdf
Files produced by the author(s)

Identifiers

Citation

Ali Fakeri-Tabrizi, Massih-Reza Amini, Patrick Gallinari. Multiview Semi-Supervised Ranking for Automatic Image Annotation. ACM International Conference on Multimedia, Oct 2013, Barcelone, Spain. pp.513-516, ⟨10.1145/2502081.2502136⟩. ⟨hal-00881259⟩

Share

Metrics

Record views

464

Files downloads

194