Wearables and Social Signal Processing for Smarter Public Presentations

Alaeddine Mihoub (1) , Grégoire Lefebvre (1)

1 Orange Labs [Meylan]

Social Signal Processing 1 techniques have given the opportunity to analyze in-depth human behavior in social face-to-face interactions. With recent advancements, it is henceforth possible to use these techniques to augment social interactions, especially human behavior in oral presentations. The goal of this study is to train a computational model able to provide a relevant feedback to a public speaker concerning his coverbal communication. Hence, the role of this model is to augment the social intelligence of the orator and then the relevance of his/her presentation. To this end, we present an original interaction setting in which the speaker is equipped with only wearable devices. Several coverbal modalities have been extracted and automatically annotated namely speech volume, intonation, speech rate, eye gaze, hand gestures and body movements. In this paper, which is an extension of our previous article published in IUI'17, we compare our Dynamic Bayesian Network design to classical J48/MLP/SVM classifiers; propose a subjective evaluation of presenter skills with a discussion in regards to our automatic evaluation; and we add a complementary study about using DBScan versus K-means algorithm in the design process of our Dynamic Bayesian Network.

Mots clés: Oral presentation; Social intelligence; Wearable devices; Multimodal behavior assessment; Dynamic Bayesian Network

Domaines: Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]; Traitement du signal et de l'image [eess.SP]

Alaeddine Mihoub, Grégoire Lefebvre. Wearables and Social Signal Processing for Smarter Public Presentations. ACM Transactions on Interactive Intelligent Systems , 2019, Highlights of ACM IUI 2017, 9 (2-3), pp.9. ⟨10.1145/3234507⟩. ⟨hal-01901691⟩