From passive to interactive object learning and recognition through self-identification on a humanoid robot

Natalia Lyubova 1 Serena Ivaldi 2 David Filliat 3, 4
2 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
3 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : Service robots, working in evolving human environments , need the ability to continuously learn to recognize new objects. Ideally, they should act as humans do, by observing their environment and interacting with objects, without specific supervision. Taking inspiration from infant development, we propose a developmental approach that enables a robot to progressively learn objects appearances in a social environment: first, only through observation, then through active object manipulation. We focus on incremen-tal, continuous, and unsupervised learning that does not require prior knowledge about the environment or the robot. In the first phase, we analyse the visual space and detect proto-objects as units of attention that are learned and recognized as possible physical entities. The appearance of each entity is represented as a multi-view model based on complementary visual features. In the second phase, entities are classified into three categories: parts of the body of the robot, parts of a human partner, and manipulable objects. The cate-gorization approach is based on mutual information between the visual and proprioceptive data, and on motion behaviour of entities. The ability to categorize entities is then used during interactive object exploration to improve the previously acquired objects models. The proposed system is implemented and evaluated with an iCub and a Meka robot learning 20 objects. The system is able to recognize objects with 88.5% success and create coherent representation models that are further improved by interactive learning.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [73 references]  Display  Hide  Download
Contributor : David Filliat <>
Submitted on : Monday, June 22, 2015 - 10:47:53 AM
Last modification on : Tuesday, December 18, 2018 - 4:40:22 PM
Document(s) archivé(s) le : Tuesday, April 25, 2017 - 6:16:51 PM


Files produced by the author(s)



Natalia Lyubova, Serena Ivaldi, David Filliat. From passive to interactive object learning and recognition through self-identification on a humanoid robot. Autonomous Robots, Springer Verlag, 2015, pp.23. ⟨10.1007/s10514-015-9445-0⟩. ⟨hal-01166110⟩



Record views


Files downloads