Skip to Main content Skip to Navigation
Conference papers

A Deep Learning Approach for Multi-View Engagement Estimation of Children in a Child-Robot Joint Attention Task

Abstract : In this work we tackle the problem of child engagement estimation while children freely interact with a robot in a friendly, room-like environment. We propose a deep-based multi-view solution that takes advantage of recent developments in human pose detection. We extract the child's pose from different RGB-D cameras placed regularly in the room, fuse the results and feed them to a deep neural network trained for classifying engagement levels. The deep network contains a recurrent layer, in order to exploit the rich temporal information contained in the pose data. The resulting method outperforms a number of baseline classifiers, and provides a promising tool for better automatic understanding of a child's attitude, interest and attention while cooperating with a robot. The goal is to integrate this model in next generation social robots as an attention monitoring tool during various Child Robot Interaction (CRI) tasks both for Typically Developed (TD) children and children affected by autism (ASD).
Document type :
Conference papers
Complete list of metadatas

Cited literature [37 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02324118
Contributor : Mehdi Khamassi <>
Submitted on : Monday, October 21, 2019 - 7:12:13 PM
Last modification on : Tuesday, January 14, 2020 - 1:08:02 PM
Document(s) archivé(s) le : Wednesday, January 22, 2020 - 8:37:35 PM

File

ASD_Eng_IROS19_v1.3.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02324118, version 1

Citation

Jack Hadfield, Georgia Chalvatzaki, Petros Koutras, Mehdi Khamassi, Costas Tzafestas, et al.. A Deep Learning Approach for Multi-View Engagement Estimation of Children in a Child-Robot Joint Attention Task. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2019), Nov 2019, Macau, China. ⟨hal-02324118⟩

Share

Metrics

Record views

27

Files downloads

38