Multimodal behavioral cues analysis of the sense of presence and co-presence during a social interaction with a virtual patient - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Frontiers in Computer Science Année : 2022

Multimodal behavioral cues analysis of the sense of presence and co-presence during a social interaction with a virtual patient

Résumé

A key challenge when studying human-agent interaction, is the evaluation of user's experience. In virtual reality, this question is addressed through the study of the sense of presence and copresence, generally assessed thanks to well-grounded subjective post-experience questionnaires. In this article, we aim at correlating objective multimodal cues produced by users to their subjective sense of presence and co-presence. Our study is based on a human-agent interaction corpus collected in task-oriented context: a virtual environment aiming at training doctors to break bad news to a patient played by a virtual agent. Based on a corpus study, we have used machine learning approaches to explore the possibility of automatically predicting the sense of presence and co-presence of the user thanks to specific multimodal behavioral cues. The performance of random forests models demonstrates the capacity to automatically and accurately predict the level of presence. It also shows the relevance of a multimodal model, based on verbal and non-verbal behavioral cues as objective measures of presence.
Fichier principal
Vignette du fichier
ArticleFrontier_Presence_Ochsetal2021.pdf (1015.92 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03657474 , version 1 (03-05-2022)

Licence

Paternité

Identifiants

  • HAL Id : hal-03657474 , version 1

Citer

Magalie Ochs, Jérémie Bousquet, Jean-Marie Pergandi, Philippe Blache. Multimodal behavioral cues analysis of the sense of presence and co-presence during a social interaction with a virtual patient. Frontiers in Computer Science, 2022. ⟨hal-03657474⟩
133 Consultations
146 Téléchargements

Partager

Gmail Facebook X LinkedIn More