Skip to Main content Skip to Navigation
Conference papers

Challenges for operationalizing XAI in Critical Interactive Systems

Célia Martinie 1
1 IRIT-ICS - Interactive Critical Systems
IRIT - Institut de recherche en informatique de Toulouse
Abstract : Large scale critical interactive systems (e.g. aircraft cockpits, satellite command and control applications…) aim to carry out complex missions. Users of such system usually perform predefined tasks for which they are trained and qualified. Nowadays, critical systems tend to embed an increasing number of on-board sensors, which collect large amounts of data to be interpreted and extrapolated, which tend to make more complex user tasks. Artificial Intelligence (AI) could be a powerful option to support the users in managing their tasks and handling this complexity. However, operationalizing AI in critical interactive systems requires proving that the AI behavior is consistent with user tasks, as well as transparent to the users and to the certification stakeholders. Explainable AI (XAI) is key as it could be a significant mean to satisfy this requirement. Nevertheless, at the same time, XAI will also have to comply with needs and common practices for the design and development of critical interactive systems. This position paper discusses the main challenges for operationalizing XAI in critical interactive systems.
Complete list of metadata
Contributor : Célia Martinie Connect in order to contact the contributor
Submitted on : Wednesday, May 12, 2021 - 12:33:10 PM
Last modification on : Tuesday, October 19, 2021 - 2:23:37 PM
Long-term archiving on: : Friday, August 13, 2021 - 6:02:45 PM


Files produced by the author(s)


  • HAL Id : hal-03221502, version 1


Célia Martinie. Challenges for operationalizing XAI in Critical Interactive Systems. ACM CHI Workshop on Operationalizing Human-Centered Perspectives in Explainable AI (HCXAI @ CHI 2021), ACM, May 2021, Online Virtual Conference (originally Yokohama), Japan. ⟨hal-03221502⟩



Les métriques sont temporairement indisponibles