A Learning to Rank framework applied to text-image retrieval

Abstract : We present a framework based on a Learning to Rank setting for a text-image retrieval task. In Information Retrieval, the goal is to compute the similarity between a document and an user query. In the context of text-image retrieval where several similarities exist, human intervention is often needed to decide on the way to combine them. On the other hand, with the Learning to Rank approach the combination of the similarities is done automatically. Learning to Rank is a paradigm where the learnt objective function is able to produce a ranked list of images when a user query is given. These score functions are generally a combination of similarities between a document and a query. In the past, Learning to Rank algorithms were successfully applied to text retrieval where they outperformed baselines such as BM25 or TFIDF. This inspired us to apply our state-of-the-art algorithm, called OWPC (Usunier et al. 2009), to the text-image retrieval task. At this time, no benchmarks are available, therefore we present a framework for building one. The empirical validation of this algorithm is done on the dataset constructed through comparison of typical text-image retrieval similarities. In both cases, visual only and text and visual, our algorithm performs better than a simple baseline.
Document type :
Journal articles
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01172660
Contributor : Lip6 Publications <>
Submitted on : Tuesday, July 7, 2015 - 4:18:32 PM
Last modification on : Thursday, March 21, 2019 - 2:52:03 PM

Links full text

Identifiers

Citation

David Buffoni, Sabrina Tollari, Patrick Gallinari. A Learning to Rank framework applied to text-image retrieval. Multimedia Tools and Applications, Springer Verlag, 2012, 60 (1), pp.161-180. ⟨10.1007/s11042-011-0806-1⟩. ⟨hal-01172660⟩

Share

Metrics

Record views

95