High Quality Reconstruction of Dynamic Objects using 2D-3D Camera Fusion

Cansen Jiang (1) , Dennis Christie (2) , Danda Pani Paudel (3) , Cédric Demonceaux (1)

1 Le2i - Laboratoire Electronique, Informatique et Image [UMR6306]
2 UG - Gunadarma University
3 Computer Vision Laboratory - ETHZ [Zurich]

In this paper, we propose a complete pipeline for high quality reconstruction of dynamic objects using 2D-3D camera setup attached to a moving vehicle. Starting from the segmented motion trajectories of individual objects, we compute their precise motion parameters, register multiple sparse point clouds to increase the density, and develop a smooth and textured surface from the dense (but scattered) point cloud. The success of our method relies on the proposed optimization framework for accurate motion estimation between two sparse point clouds. Our formulation for fusing it closest-point and it consensus based motion estimations, respectively in the absence and presence of motion trajectories, is the key to obtain such accuracy. Several experiments performed on both synthetic and real (KITTI) datasets show that the proposed framework is very robust and accurate.

Mots clés: 3D Reconstruction; 2D-3D Fusion; Point Cloud Registration; RANSAC; ICP

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement des images [eess.IV]

Cansen Jiang, Dennis Christie, Danda Pani Paudel, Cédric Demonceaux. High Quality Reconstruction of Dynamic Objects using 2D-3D Camera Fusion. IEEE International Conference on Image Processing - ICIP, Sep 2017, Beijing, China. ⟨hal-01528396v2⟩