Skip to Main content Skip to Navigation
Journal articles

Haptic Zero-Shot Learning: Recognition of Objects Never Touched Before

Zineb Abderrahmane 1 Gowrishankar Ganesh 2, 1 André Crosnier 1 Andrea Cherubini 1
1 IDH - Interactive Digital Humans
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : Object recognition is essential to enable robots to interact with their environment. Robots should be capable, on one hand of recognizing previously experienced objects, and on the other, of using the experienced objects for learning novel objects, i.e. objects for which training data are not available. Recognition of such novel objects can be achieved with Zero-Shot Learning (ZSL). In this work, we show the potential of ZSL for haptic recognition. First, we design a zero-shot haptic recognition algorithm and, using the extensive PHAC-2 database [1] as well as our own, we adapt, analyze and optimize the ZSL for the challenges and constraints characteristic of haptic recognition. Finally, we apply the optimized algorithm for haptic recognition of daily-life objects using an anthropomorphic robot hand. Our algorithm enables the robot to recognize eight of the ten novel objects handed to it.
Complete list of metadatas

Cited literature [56 references]  Display  Hide  Download
Contributor : Andrea Cherubini <>
Submitted on : Monday, October 30, 2017 - 2:50:46 AM
Last modification on : Thursday, May 16, 2019 - 12:48:01 PM
Document(s) archivé(s) le : Wednesday, January 31, 2018 - 12:12:48 PM


Files produced by the author(s)




Zineb Abderrahmane, Gowrishankar Ganesh, André Crosnier, Andrea Cherubini. Haptic Zero-Shot Learning: Recognition of Objects Never Touched Before. Robotics and Autonomous Systems, Elsevier, 2018, 105, pp.11-25. ⟨10.1016/j.robot.2018.03.002⟩. ⟨hal-01625945⟩



Record views


Files downloads