Evaluation Metric for Image understanding

Baptiste Hemery (1) , Hélène Laurent (2) , Christophe Rosenberger (1)

1 Equipe SAFE - Laboratoire GREYC - UMR6072
2 PRISME - Laboratoire Pluridisciplinaire de Recherche en Ingénierie des Systèmes, Mécanique et Energétique

We propose in this paper a new evaluation metric that enables to quantify the quality of an image interpretation result. This metric takes into account the a priori knowledge used by the interpretation algorithm and the ground truth associated with the original image. We combine two metrics that evaluate the localization and recognition results of each detected object. We show that the proposed metric fulfills some theoretical properties and has a correct behavior face to empirical experiments on an image benchmark database. We think that this metric could be a reliable reference for image and video understanding competitions.

Domaines: Traitement des images [eess.IV]

Baptiste Hemery, Hélène Laurent, Christophe Rosenberger. Evaluation Metric for Image understanding. IEEE International Conference on Image Processing (ICIP), Nov 2009, Cairo, Egypt. pp.4381 - 4384, ⟨10.1109/ICIP.2009.5413548⟩. ⟨hal-00958185⟩