Explain to whom? Putting the User in the Center of Explainable AI

Alexandra Kirsch (1, 2, 3)

1 Institute for Advanced Studies
2 Intelligent Autonomous Systems
3 Human-Computer Interaction and Artificial Intelligence

The ability to explain actions and decisions is often regarded as a basic ingredient of cognitive systems. But when researchers propose methods for making AI systems understandable, users are usually not involved or even mentioned. However, the purpose is to make people willing to accept the decision of a machine or to be better able to interact with it. Therefore, I argue that the evaluation of explanations must involve some form of user testing.

Domaines: Intelligence artificielle [cs.AI]

Alexandra Kirsch. Explain to whom? Putting the User in the Center of Explainable AI. Proceedings of the First International Workshop on Comprehensibility and Explanation in AI and ML 2017 co-located with 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2017), 2017, Bari, Italy. ⟨hal-01845135⟩