Multimodal Object-Based Environment Representation for Assistive Robotics - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Social Robotics Année : 2020

Multimodal Object-Based Environment Representation for Assistive Robotics

Résumé

Autonomous robots are nowadays successfully used in industrial environments, where tasks follow predetermined plans and the world is a known (and closed) set of objects. The context of social robotics brings new challenges to the robot. First of all, the world is no longer closed. New objects can be introduced at any time, and it is now impossible to build an exaustive list of them nor having a precomputed set of descriptors. Moreover, natural interactions with a human being don’t follow any precomputed graph of sequences or grammar. To deal with the complexity of such an open world, a robot can no longer solely rely on its sensors data: a compact representation to comprehend its surrounding is needed. Our approach focuses on task independent environment representation where human-robot interactions are involved. We propose a global architecture bridging the gap between perception and semantic modalities through instances (physical realizations of semantic concepts). In this article, we describe a method for automatic generation of object-related ontology. Based on it, a practical formalization of the ill-defined notion of “context” is discussed. We then tackle human-robot interactions in our system through the description of user request processing. Finally, we illustrate the flow of our model on two showcases which demonstrate the validity of the approach.
Fichier principal
Vignette du fichier
manuscript_revised_260919.pdf (13.91 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02935451 , version 1 (16-09-2020)

Identifiants

Citer

Yohan Breux, Sébastien Druon. Multimodal Object-Based Environment Representation for Assistive Robotics. International Journal of Social Robotics, 2020, 12 (3), pp.807-826. ⟨10.1007/s12369-019-00600-4⟩. ⟨hal-02935451⟩
88 Consultations
36 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More