Skip to Main content Skip to Navigation
Conference papers

Real-time tracking of 3D elastic objects with an RGB-D sensor

Abstract : This paper presents a method to track in real-time a 3D textureless object which undergoes large deformations such as elastic ones, and rigid motions, using the point cloud data provided by an RGB-D sensor. This solution is expected to be useful for enhanced manipulation of humanoid robotic systems. Our framework relies on a prior visual segmentation of the object in the image. The segmented point cloud is registered first in a rigid manner and then by non-rigidly fitting the mesh, based on the Finite Element Method to model elasticity, and on geometrical point-to-point correspondences to compute external forces exerted on the mesh. The real-time performance of the system is demonstrated on synthetic and real data involving challenging deformations and motions.
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download
Contributor : Antoine Petit <>
Submitted on : Monday, October 16, 2017 - 2:41:11 PM
Last modification on : Friday, July 13, 2018 - 9:14:01 PM
Document(s) archivé(s) le : Wednesday, January 17, 2018 - 2:18:35 PM


Files produced by the author(s)




Antoine Petit, Vincenzo Lippiello, Bruno Siciliano. Real-time tracking of 3D elastic objects with an RGB-D sensor. IROS 2015 - IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, Sep 2015, Hamburg, Germany. pp.3914-3921, ⟨10.1109/IROS.2015.7353928⟩. ⟨hal-01617309⟩



Record views


Files downloads