Towards Force Sensing From Vision: Observing Hand-Object Interactions to Infer Manipulation Forces - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Towards Force Sensing From Vision: Observing Hand-Object Interactions to Infer Manipulation Forces

Résumé

We present a novel, non-intrusive approach for estimating contact forces during hand-object interactions relying solely on visual input provided by a single RGB-D camera. We consider a manipulated object with known geometrical and physical properties. First, we rely on model-based visual tracking to estimate the object's pose together with that of the hand manipulating it throughout the motion. Following this, we compute the object's first and second order kinematics using a new class of numerical differentiation operators. The estimated kinematics is then instantly fed into a second-order cone program that returns a minimal force distribution explaining the observed motion. However, humans typically apply more forces than mechanically required when manipulating objects. Thus, we complete our estimation method by learning these excessive forces and their distribution among the fingers in contact. We provide a full validity analysis of the proposed method by evaluating it based on ground truth data from additional sensors such as accelerometers, gyroscopes and pressure sensors. Experimental results show that force sensing from vision (FSV) is indeed feasible.
Fichier principal
Vignette du fichier
fsv_cvpr2015.pdf (1.26 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01356136 , version 1 (25-08-2016)

Identifiants

Citer

Tu-Hoa Pham, Abderrahmane Kheddar, Ammar Qammaz, Antonis A. Argyros. Towards Force Sensing From Vision: Observing Hand-Object Interactions to Infer Manipulation Forces. CVPR: Computer Vision and Pattern Recognition, Jun 2015, Boston, MA, United States. pp.2810-2819, ⟨10.1109/CVPR.2015.7298898⟩. ⟨hal-01356136⟩
270 Consultations
572 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More