Explainability of Image Semantic Segmentation Through SHAP Values - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Explainability of Image Semantic Segmentation Through SHAP Values

Résumé

The introduction of Deep Neural Networks in high-level applications is significantly increasing. However, the understanding of such model decisions by humans is not straightforward and may limit their use for critical applications. In order to address this issue, recent research work has introduced explanation methods, typically for classification and captioning. Nevertheless, for some tasks, explainability methods need to be developed. This includes image segmentation that is an essential component for many high-level applications. In this paper, we propose a general workflow allowing for the adaptation of a state of the art explainability methods, especially SHAP, to image segmentation tasks. The approach allows for explanation of single pixels as well image areas. We show the relevance of the approach on a critical application such as oil slick pollution detection on the sea surface. We also show the applicability of the method on a more standard multimedia domain semantic segmentation task. The conducted experiments highlight the relevant features on which the models derive their local results and help identify general model behaviours.
Fichier principal
Vignette du fichier
SHAP2022_ICPR-benoit_al.pdf (11.35 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03719597 , version 1 (11-07-2022)
hal-03719597 , version 2 (07-11-2022)

Identifiants

  • HAL Id : hal-03719597 , version 2

Citer

Pierre Dardouillet, Alexandre Benoit, Emna Amri, Philippe Bolon, Dominique Dubucq, et al.. Explainability of Image Semantic Segmentation Through SHAP Values. ICPR-XAIE -26TH International Conference on Pattern Recognition 2-nd Workshop on Explainable and Ethical AI, Aug 2022, Montreal, Canada. ⟨hal-03719597v2⟩
967 Consultations
276 Téléchargements

Partager

Gmail Facebook X LinkedIn More