Capturing and Reproducing Hand-Object Interactions Through Vision-Based Force Sensing

Abstract : Capturing and reproducing hand-objects interactions would open considerable possibilities in computer vision, human-computer interfaces, robotics, animation and rehabilitation. Recently, we witnessed impressive vision-based hand tracking solutions that can potentially be used for such purposes. Yet, a challenging question is: to what extent can vision also capture haptic interactions? These induce motions and constraints that are key for learning and understanding tasks, such as dexterous grasping, manipulation and assembly, as well as enabling their reproduction from either virtual characters or physical embodiments. Contact forces are traditionally measured by means of haptic technologies such as force transducers, whose major drawback lies in their intrusiveness, with respect to the manipulated objects (impacting their physical properties) and the operator's hands (obstructing the human haptic senses). Others include their extensive need for calibration, time-varying accuracy and cost. In this paper, we present the force sensing from vision framework to capture haptic interaction by means of a cheap and simple set-up (e.g., a single RGB-D camera). We then illustrate its use as an implicit force model improving the reproduction of hand-object manipulation scenarios even in poor performance visual tracking conditions.
Type de document :
Communication dans un congrès
Object Understanding for Interaction, Dec 2015, Santiago, Chile. 1st Workshop on Object Understanding for Interaction @ ICCV: International Conference on Computer Vision, 2015, 〈http://oui.csail.mit.edu/index.html〉
Liste complète des métadonnées

Littérature citée [7 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01372238
Contributeur : Tu-Hoa Pham <>
Soumis le : mardi 27 septembre 2016 - 09:17:53
Dernière modification le : samedi 25 novembre 2017 - 10:16:12
Document(s) archivé(s) le : mercredi 28 décembre 2016 - 12:44:14

Fichier

oui_fsv_abstract_final.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01372238, version 1

Collections

Citation

Tu-Hoa Pham, Abderrahmane Kheddar, Ammar Qammaz, Antonis Argyros. Capturing and Reproducing Hand-Object Interactions Through Vision-Based Force Sensing. Object Understanding for Interaction, Dec 2015, Santiago, Chile. 1st Workshop on Object Understanding for Interaction @ ICCV: International Conference on Computer Vision, 2015, 〈http://oui.csail.mit.edu/index.html〉. 〈hal-01372238〉

Partager

Métriques

Consultations de la notice

106

Téléchargements de fichiers

140