Skip to Main content Skip to Navigation
Conference papers

Creating an interactive human/agent loop using multimodal recurrent neural networks

Abstract : This paper presents a description of ongoing research that aims to improve the interaction between human and Embodied Conversational Agent (ECA). The main idea is to model the interactive loop between human and agent such as the virtual agent can continuously adapt its behavior according to one's partner. This work, based on recurrent neural network, focuses on non-verbal behavior generation and presents several scientific locks like the multimodality, the intra-personal temporality of multimodal signals or the temporality between partner's social cues. The modeling will be done using the NOXI database containing natural human/human interactions and the nonverbal behavior generation will be tested on the GRETA platform that simulates virtual agents.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03377542
Contributor : Ccsd Sciencesconf.Org Connect in order to contact the contributor
Submitted on : Thursday, October 14, 2021 - 11:14:40 AM
Last modification on : Saturday, October 16, 2021 - 3:50:42 AM

File

WACAI_2021_Jieyeon_WOO_Relectu...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03377542, version 1

Citation

Jieyeon Woo, Catherine Pelachaud, Catherine Achard. Creating an interactive human/agent loop using multimodal recurrent neural networks. WACAI 2021, Centre National de la Recherche Scientifique [CNRS], Oct 2021, Saint Pierre d'Oléron, France. ⟨hal-03377542⟩

Share

Metrics

Record views

71

Files downloads

75