Image search with selective match kernels: aggregation across single and multiple images

G. Tolias (1) , Yannis Avrithis (2) , Hervé Jégou (1)

1 LinkMedia - Creating and exploiting explicit links between multimedia fragments
2 NTUA - National Technical University of Athens [Athens]

This paper considers a family of metrics to compare images based on their local descriptors. It encompasses the VLAD descriptor and matching techniques such as Hamming Embedding. Making the bridge between these approaches leads us to propose a match kernel that takes the best of existing techniques by combining an aggregation procedure with a selective match kernel. The representation underpinning this kernel is approximated, providing a large scale image search both precise and scalable, as shown by our experiments on several benchmarks. We show that the same aggregation procedure, originally applied per image, can effectively operate on groups of similar features found across multiple images. This method implicitly performs feature set augmentation, while enjoying savings in memory requirements at the same time. Finally, the proposed method is shown effective for place recognition , outperforming state of the art methods on a large scale landmark recognition benchmark.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

G. Tolias, Yannis Avrithis, Hervé Jégou. Image search with selective match kernels: aggregation across single and multiple images. International Journal of Computer Vision, 2015, 116 (3), pp.247-261. ⟨10.1007/s11263-015-0810-4⟩. ⟨hal-01131898⟩