Public Speaking Training with a Multimodal Interactive Virtual Audience Framework

Mathieu Chollet (1) , Kalin Stefanov (2) , Helmut Prendinger (3) , Stefan Scherer (1)

1 ICT - Institute for Creative Technologies
2 KTH TMH - Department of Speech, Music and Hearing [KTH Stockholm]
3 NII - National Institute of Informatics

We have developed an interactive virtual audience platform for public speaking training. Users' public speaking behavior is automatically analyzed using multimodal sensors, and ultimodal feedback is produced by virtual characters and generic visual widgets depending on the user's behavior. The flexibility of our system allows to compare different interaction mediums (e.g. virtual reality vs normal interaction), social situations (e.g. one-on-one meetings vs large audiences) and trained behaviors (e.g. general public speaking performance vs specific behaviors).

Domaines: Environnements Informatiques pour l'Apprentissage Humain; Intelligence artificielle [cs.AI]; Interface homme-machine [cs.HC]

Mathieu Chollet, Kalin Stefanov, Helmut Prendinger, Stefan Scherer. Public Speaking Training with a Multimodal Interactive Virtual Audience Framework. International Conference on Multimodal Interaction, Nov 2015, Seattle, United States. pp.367-368, ⟨10.1145/2818346.2823294⟩. ⟨hal-02439103⟩