Lightweight web image reranking

Adrian Popescu (1) , Pierre-Alain Moellic (2) , Ioannis Kanellos (1) , Rémi Landais (3)

1 INFO - Département informatique
2 LIST (CEA) - Laboratoire d'Intégration des Systèmes et des Technologies
3 Exalead (.)

Web image search is inspired by text search techniques; it mainly relies on indexing textual data that surround the image file. But retrieval results are often noisy and image processing techniques have been proposed to rerank images. Unfortunately, these techniques usually imply a computational overload that makes the reranking process intractable in real time. We introduce here a lightweight reranking method that compares each result not only to the other query results but also to an external, contrastive class of items. The external class contains diversified images; the intuition supporting our approach is that results that are visually similar to other query results but dissimilar to elements of the contrastive class are likely to be good answers. The success of visual reranking depends on the visual coherence of queries; we measure this coherence in order to evaluate the chances of success. Visual reranking tends to emerge near duplicate images and we complement it with a diversification function which ensures that different aspects of a query are presented to the user. Our method is evaluated against a standard search engine using 210 diversified queries. Significant improvements are reported for both quantitative and qualitative tests.

Mots clés: Image retrieval; Reranking; K-NN

Domaines: Traitement du signal et de l'image [eess.SP]

Adrian Popescu, Pierre-Alain Moellic, Ioannis Kanellos, Rémi Landais. Lightweight web image reranking. ACM Multimedia 2009 : 17th ACM international conference on Multimedia, Oct 2009, Pékin, China. pp.657 - 660, ⟨10.1145/1631272.1631381⟩. ⟨hal-02345837⟩