Multimodal Expressions of Stress during a Public Speaking Task: Collection, Annotation and Global Analyses

Tom Giraud (1) , Marie Soury (1) , Jiewen Hua (2) , Agnes Delaborde (1) , Marie Tahon (1) , David Antonio Gómez Jáuregui (1) , Victoria Eyharabide (1) , Edith Filaire (2) , Christine Le Scanff (2) , Laurence Devillers (1) , Brice Isableu (2) , Jean-Claude Martin (1)

1 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
2 CIAMS - Complexité, Innovation, Activités Motrices et Sportives

Databases of spontaneous multimodal expressions of affective states occurring during a task are few. This paper presents a protocol for eliciting stress in a public speaking task. Behaviors of 19 participants were recorded via a multimodal setup including speech, video of the facial expressions and body movements, balance via a force plate, and physiological measures. Questionnaires were used to assert emotional states, personality profiles and relevant coping behaviors to study how participants cope with stressful situations. Several subjective and objective performances were also evaluated. Results show a significant impact of the overall task and conditions on the participants' emotional activation. The possible future use of this new multimodal emotional corpus is described.

Mots clés: stress; emotion; multimodality; individual differences; databases

Domaines: Traitement du signal et de l'image [eess.SP]; Interface homme-machine [cs.HC]; Traitement des images [eess.IV]; Base de données [cs.DB]; Psychologie

Tom Giraud, Marie Soury, Jiewen Hua, Agnes Delaborde, Marie Tahon, et al.. Multimodal Expressions of Stress during a Public Speaking Task: Collection, Annotation and Global Analyses. 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII 2013), Sep 2013, Genève, Switzerland. ⟨10.1109/ACII.2013.75⟩. ⟨hal-01443842⟩