Haptic Zero-Shot Learning: Recognition of Objects Never Touched Before

Zineb Abderrahmane (1) , Gowrishankar Ganesh (1, 2) , André Crosnier (1) , Andrea Cherubini (1)

1 IDH - Interactive Digital Humans
2 CNRS-AIST JRL - Joint Robotics Laboratory

Object recognition is essential to enable robots to interact with their environment. Robots should be capable, on one hand of recognizing previously experienced objects, and on the other, of using the experienced objects for learning novel objects, i.e. objects for which training data are not available. Recognition of such novel objects can be achieved with Zero-Shot Learning (ZSL). In this work, we show the potential of ZSL for haptic recognition. First, we design a zero-shot haptic recognition algorithm and, using the extensive PHAC-2 database [1] as well as our own, we adapt, analyze and optimize the ZSL for the challenges and constraints characteristic of haptic recognition. Finally, we apply the optimized algorithm for haptic recognition of daily-life objects using an anthropomorphic robot hand. Our algorithm enables the robot to recognize eight of the ten novel objects handed to it.

Mots clés: Haptic recognition; Zero-shot learning; Attribute-based description; Robotic hand

Domaines: Robotique [cs.RO]; Automatique / Robotique; Apprentissage [cs.LG]

Zineb Abderrahmane, Gowrishankar Ganesh, André Crosnier, Andrea Cherubini. Haptic Zero-Shot Learning: Recognition of Objects Never Touched Before. Robotics and Autonomous Systems, 2018, 105, pp.11-25. ⟨10.1016/j.robot.2018.03.002⟩. ⟨hal-01625945⟩