EMODA: a tutor oriented multimodal and contextual emotional dashboard

Mohamed Ez-Zaouia 1 Elise Lavoué 1
1 SICAL - Situated Interaction, Collaboration, Adaptation and Learning
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Learners' emotional state has proven to be a key factor for successful learning. Visualizing learners' emotions during synchronous on-line learning activities can help tutors in creating and maintaining socio-affective relationships with their learners. However, few dashboards offer emotional information on the learning activity. The current study focuses on synchronous interactions via a videoconferencing tool dedicated to foreign language training. We collected data on learners' emotions in real conditions during ten sessions (five sessions for two learners). We propose to adopt and combine different models of emotions (discrete and dimensional) and to use heterogeneous APIs for measuring learners' emotions from different data sources (audio, video, self-reporting and interaction traces). Based on a thorough data analysis, we propose an approach to combine different cues to infer information on learners' emotional states. We finally present the EMODA dashboard, an affective multimodal and contextual visual analytics dashboard, which allows the tutor to monitor learners' emotions and better understand their evolution during the synchronous learning activity.
Document type :
Conference papers
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01497669
Contributor : Elise Lavoué <>
Submitted on : Monday, April 3, 2017 - 9:59:39 AM
Last modification on : Wednesday, November 20, 2019 - 2:38:19 AM
Long-term archiving on : Tuesday, July 4, 2017 - 12:10:21 PM

File

EMODA-LAK2017.pdf
Files produced by the author(s)

Identifiers

Citation

Mohamed Ez-Zaouia, Elise Lavoué. EMODA: a tutor oriented multimodal and contextual emotional dashboard. Seventh International Learning Analytics & Knowledge Conference (LAK 2017), Mar 2017, Vancouver, Canada. pp.429-438, ⟨10.1145/3027385.3027434⟩. ⟨hal-01497669⟩

Share

Metrics

Record views

346

Files downloads

453