Adaptive image retrieval based on the spatial organization of colors

Thomas Hurtut (1) , Yann Gousseau (1) , Francis Schmitt (1)

1 LTCI - Laboratoire Traitement et Communication de l'Information

This work proposes to compare the spatial organization of colors between images through a global optimization procedure relying on the Earth Mover's Distance. The resulting distance is applied to image retrieval. Unlike most region-based retrieval systems, no segmentation of images is needed for the query. We then address the decision stage of the retrieval, that is the problem of automatically deciding which images from a database match a query. To this aim, we make use of an a contrario method. Two images are matched if their proximity is unlikely to be due to chance; more precisely, a matching threshold on distances is computed by controlling the average number of false matchings in an unsupervised way. This threshold is adaptive, yielding different numbers of result images depending on the query and the database.

Mots clés: Spatial organization of colors; Color image retrieval; A contrario method; Earth Mover's Distance; Optimal transport; Dead leaves model; Image distance

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Thomas Hurtut, Yann Gousseau, Francis Schmitt. Adaptive image retrieval based on the spatial organization of colors. Computer Vision and Image Understanding, 2008, 112 (2), pp.101-113. ⟨10.1016/j.cviu.2007.12.006⟩. ⟨hal-00430456⟩