Visuo-Tactile Recognition of Daily-Life Objects Never Seen or Touched Before

Zineb Abderrahmane 1 Gowrishankar Ganesh 2, 1 André Crosnier 1 Andrea Cherubini 1
1 IDH - Interactive Digital Humans
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : This study proposes a visuo-tactile Zero-Shot object recognition framework. The proposed framework recognizes a set of novel objects for which no tactile or visual training data are available. It uses visuo-tactile training data collected from known objects to recognize the novel ones, given their attributes. This framework extends the haptic Zero-Shot Learning framework that we proposed in [1] with vision, which enables a multimodal recognition system. In our test with the PHAC-2 dataset, the system was able to get a recognition accuracy of 72% among 6 objects that were never touched or seen during the training phase.
Complete list of metadatas

Cited literature [1 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01869015
Contributor : Andrea Cherubini <>
Submitted on : Thursday, September 6, 2018 - 10:48:37 AM
Last modification on : Thursday, May 16, 2019 - 12:48:01 PM
Long-term archiving on : Friday, December 7, 2018 - 4:55:08 PM

File

icarcv_zineb.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Zineb Abderrahmane, Gowrishankar Ganesh, André Crosnier, Andrea Cherubini. Visuo-Tactile Recognition of Daily-Life Objects Never Seen or Touched Before. ICARCV: International Conference on Control, Automation, Robotics and Vision, Nov 2018, Singapore, Singapore. pp.1765-1770, ⟨10.1109/ICARCV.2018.8581230⟩. ⟨hal-01869015⟩

Share

Metrics

Record views

137

Files downloads

91