Skip to Main content Skip to Navigation
Journal articles

Calibration and External Force Sensing for Soft Robots using an RGB-D Camera

Zhongkai Zhang 1, 2 Antoine Petit 3 Jeremie Dequidt 1, 2 Christian Duriez 1, 2
2 DEFROST - Deformable Robots Simulation Team
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : Benefiting from the deformability of soft robots, calibration and force sensing for soft robots are possible using an external vision-based system, instead of embedded mechatronic force sensors. In this paper, we first propose a calibration method to calibrate both the sensor-robot coordinate system and the actuator inputs. This task is addressed through a sequential optimization problem for both variables. We also introduce an external force sensing system based on a real-time Finite Element (FE) model with the assumption of static configurations, and which consists of two steps: force location detection and force intensity computation. The algorithm that estimates force location relies on the segmentation of the point cloud acquired by an RGB-D camera. Then, the force intensities can be computed by solving an inverse quasi-static problem based on matching the FE model with the point cloud of the soft robot. As for validation, the proposed strategies for calibration and force sensing have been tested using a parallel soft robot driven by four cables.
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download
Contributor : Zhongkai Zhang <>
Submitted on : Thursday, March 7, 2019 - 5:53:15 PM
Last modification on : Monday, April 20, 2020 - 10:14:31 AM
Document(s) archivé(s) le : Sunday, June 9, 2019 - 10:13:05 AM


Calibration and External Force...
Files produced by the author(s)



Zhongkai Zhang, Antoine Petit, Jeremie Dequidt, Christian Duriez. Calibration and External Force Sensing for Soft Robots using an RGB-D Camera. IEEE Robotics and Automation Letters, IEEE 2019, 4 (3), pp.2356 - 2363. ⟨10.1109/LRA.2019.2903356⟩. ⟨hal-02060976⟩



Record views


Files downloads