Skip to Main content Skip to Navigation
Conference papers

HRI-RNN: A User-Robot Dynamics-Oriented RNN for Engagement Decrease Detection

Abstract : Natural and fluid human-robot interaction (HRI) systems rely on the robot's ability to accurately assess the user's engagement in the interaction. Current HRI systems for engagement analysis , and more broadly emotion recognition, only consider user data while discarding robot data which, in many cases, affects the user state. We present a novel recurrent neural architecture for online detection of user engagement decrease in a spontaneous HRI setting that exploits the robot data. Our architecture models the user as a distinct party in the conversation and uses the robot data as contextual information to help assess engagement. We evaluate our approach on a real-world highly imbal-anced data set, where we observe up to 2.13% increase in F1 score compared to a standard gated recurrent unit (GRU).
Complete list of metadata

Cited literature [25 references]  Display  Hide  Download
Contributor : Asma Atamna Connect in order to contact the contributor
Submitted on : Saturday, August 1, 2020 - 11:40:27 PM
Last modification on : Tuesday, February 1, 2022 - 3:35:54 AM
Long-term archiving on: : Monday, November 30, 2020 - 12:46:54 PM


Files produced by the author(s)


  • HAL Id : hal-02910344, version 1



Asma Atamna, Chloé Clavel. HRI-RNN: A User-Robot Dynamics-Oriented RNN for Engagement Decrease Detection. INTERSPEECH 2020, Oct 2020, Shanghai, China. ⟨hal-02910344⟩



Record views


Files downloads