What if Social Robots Look for Productive Engagement?

Jauwairia Nasir (1, 2) , Barbara Bruno (1, 2) , Mohamed Chetouani (3, 4) , Pierre Dillenbourg (1, 2)

1 EPFL - Ecole Polytechnique Fédérale de Lausanne
2 CHILI - Computer-Human Interaction in Learning and Instruction
3 SU - Sorbonne Université
4 ISIR - Institut des Systèmes Intelligents et de Robotique

In educational HRI, it is generally believed that a robots behavior has a direct effect on the engagement of a user with the robot, the task at hand and also their partner in case of a collaborative activity. Increasing this engagement is then held responsible for increased learning and productivity. The state of the art usually investigates the relationship between the behaviors of the robot and the engagement state of the user while assuming a linear relationship between engagement and the end goal: learning. However, is it correct to assume that to maximise learning, one needs to maximise engagement? Furthermore, conventional supervised models of engagement require human annotators to get labels. This is not only laborious but also introduces further subjectivity in an already subjective construct of engagement. Can we have machine-learning models for engagement detection where annotations do not rely on human annotators? Looking deeper at the behavioral patterns and the learning outcomes and a performance metric in a multi-modal data set collected in an educational human-human-robot setup with 68 students, we observe a hidden link that we term as Productive Engagement. We theorize a robot incorporating this knowledge will (1) distinguish teams based on engagement that is conducive of learning; and (2) adopt behaviors that eventually lead the users to increased learning by means of being productively engaged. Furthermore, this seminal link paves way for machine-learning models in educational HRI with automatic labelling based on the data.

Mots clés: Engagement; Human-robot interaction; Learning; Educational robots; Multi-modal learning analytics

Domaines: Intelligence artificielle [cs.AI]; Traitement du signal et de l'image [eess.SP]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Robotique [cs.RO]; Informatique; Psychologie; Neurosciences

Jauwairia Nasir, Barbara Bruno, Mohamed Chetouani, Pierre Dillenbourg. What if Social Robots Look for Productive Engagement?: Automated Assessment of Goal-Centric Engagement in Learning Applications. International Journal of Social Robotics, 2022, 14, pp.55-71. ⟨10.1007/s12369-021-00766-w⟩. ⟨hal-03174537⟩