Descriptor Optimization for Multimedia Indexing and Retrieval

Bahjat Safadi 1 Nadia Derbas 1 Georges Quénot 1
1 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
Inria - Institut National de Recherche en Informatique et en Automatique, LIG - Laboratoire d'Informatique de Grenoble
Abstract : In this paper, we propose and evaluate a method for optimizing descriptors used for content-based multimedia indexing and retrieval. A large variety of descriptors are commonly used for this purpose. However, the most efficient ones often have characteristics preventing them to be easily used in large scale systems. They may have very high dimensionality (up to tens of thousands dimensions) and/or be suited for a distance which is costly to compute (e.g. Chi square). The proposed method combines a PCA-based dimensionality reduction with pre- and post-PCA non-linear transformations. The resulting transformation is globally optimized. The produced descriptors have a much lower dimensionality while performing at least as well, and often significantly better, with the Euclidean distance than the original high dimensionality descriptors with their optimal distance. Our approach also includes a hyper-parameter optimization procedure based on the use of a fast kNN classifier and on a polynomial fit to overcome the MAP metric instability. The method has been validated and evaluated on a variety of descriptors using the TRECVid 2010 semantic indexing task data. It has then be applied at large scale for the TRECVid 2012 semantic indexing task on tens of descriptors of various types and with initial dimensionalities ranging from 15 up to 32,768. The same transformation can be used also for multimedia retrieval in the context of query by example and/or of relevance.
Document type :
Journal articles
Complete list of metadatas
Contributor : Marie-Christine Fauvet <>
Submitted on : Tuesday, April 22, 2014 - 4:05:16 PM
Last modification on : Tuesday, February 12, 2019 - 1:30:58 AM

Links full text




Bahjat Safadi, Nadia Derbas, Georges Quénot. Descriptor Optimization for Multimedia Indexing and Retrieval. Multimedia Tools and Applications, Springer Verlag, 2015, 74 (4), pp.1267-1290. ⟨10.1007/s11042-014-2071-6⟩. ⟨hal-00981672⟩



Record views