MuMMER: Socially Intelligent Human-Robot Interaction in Public Spaces

Mary Ellen Foster (1) , Bart Craenen (1) , Amol Deshmukh (1) , Oliver Lemon (2) , Emanuele Bastianelli (2) , Christian Dondrup (2) , Ioannis Papaioannou (2) , Andrea Vanzo (2) , Jean-Marc Odobez (3) , Olivier Canévet (3) , Yuanzhouhan Cao (3) , Weipeng He (3) , Angel Martínez-González (3) , Petr Motlicek (3) , Rémy Siegfried (3) , Rachid Alami (4) , Kathleen Belhassein (4, 5) , Guilhem Buisan (4) , Aurélie Clodic (4) , Amandine Mayima (4) , Yoan Sallami (4) , Guillaume Sarthou (4) , Phani-Teja Singamaneni (4) , Jules Waldhart (4) , Alexandre Mazel (6) , Maxime Caniot (6) , Marketta Niemelä (7) , Päivi Heikkilä (7) , Hanna Lammi (7) , Antti Tammela (7)

1 University of Glasgow
2 HWU - Heriot-Watt University [Edinburgh]
3 IDIAP Research Institute
4 LAAS-RIS - Équipe Robotique et InteractionS
5 CLLE-LTC - Cognition, Langues, Langage, Ergonomie
6 SoftBank Robotics Europe
7 VTT - VTT Technical Research Centre of Finland

In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shopping mall. We present the latest version of the robot system developed during the project. This system encompasses audio-visual sensing, social signal processing, conversational interaction, perspective taking, geometric reasoning, and motion planning. It successfully combines all these components in an overarching framework using the Robot Operating System (ROS) and has been deployed to a shopping mall in Finland interacting with customers. In this paper, we describe the system components, their interplay, and the resulting robot behaviours and scenarios provided at the shopping mall.

Domaines: Robotique [cs.RO]

Mary Ellen Foster, Bart Craenen, Amol Deshmukh, Oliver Lemon, Emanuele Bastianelli, et al.. MuMMER: Socially Intelligent Human-Robot Interaction in Public Spaces. Artificial Intelligence for Human-Robot Interaction Symposium (AI-HRI), AAAI Fall Symposium Series 2019, Nov 2019, Arlington, VA, United States. ⟨hal-02291690⟩