A CBIR-based evaluation framework for visual attention models

Dounia Awad (1) , Matei Mancas (2) , Nicolas Riche (2) , Vincent Courboulay (1) , Arnaud Revel (1)

1 L3I - Laboratoire Informatique, Image et Interaction - EA 2118
2 UMons - Université de Mons

The computational models of visual attention, originally proposed as cognitive models of human attention, nowadays are being used as front-ends to numerous vision systems like automatic object recognition. These systems are generally evaluated against eye tracking data or manually segmented salient objects in images. We previously showed that this comparison can lead to different rankings depending on which of the two ground truths is used. These findings suggest that the saliency models ranking might be different for each application and the use of eye-tracking rankings to choose a model for a given application is not optimal. Therefore, in this paper , we propose a new saliency evaluation framework optimized for object recognition. This paper aims to answer the question: 1) Is the application-driven saliency models rank-ings consistent with classical ground truth like eye-tracking? 2) If not, which saliency models one should use for the precise CBIR applications?

Mots clés: Index Terms— saliency models; object recognition; CBIR; eye tracking; attention; saliency evaluation

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Dounia Awad, Matei Mancas, Nicolas Riche, Vincent Courboulay, Arnaud Revel. A CBIR-based evaluation framework for visual attention models. 23rd European Signal Processing Conference, {EUSIPCO}, Aug 2016, Nice, France. pp.1526-1530, ⟨10.1109/EUSIPCO.2015.7362639⟩. ⟨hal-01251404⟩