Scene Flow Estimation from RGBD Images

Julian Quiroga 1, 2
2 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : This thesis addresses the problem of reliably recovering a 3D motion field, or scene flow, from a temporal pair of RGBD images. We propose a semi-rigid estimation framework for the robust computation of scene flow, taking advantage of color and depth information, and an alternating variational minimization framework for recovering rigid and non-rigid components of the 3D motion field. Previous attempts to estimate scene flow from RGBD images have extended optical flow approaches without fully exploiting depth data or have formulated the estimation in 3D space disregarding the semi-rigidity of real scenes. We demonstrate that scene flow can be robustly and accurately computed in the image domain by solving for 3D motions consistent with color and depth, encouraging an adjustable combination between local and piecewise rigidity. Additionally, we show that solving for the 3D motion field can be seen as a specific case of a more general estimation problem of a 6D field of rigid motions. Accordingly, we formulate scene flow estimation as the search of an optimal field of twist motions achieving state-of-the-art results.
Complete list of metadatas

Cited literature [81 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/tel-01097763
Contributor : Julian Quiroga <>
Submitted on : Monday, December 22, 2014 - 4:28:49 PM
Last modification on : Wednesday, April 11, 2018 - 1:53:59 AM
Long-term archiving on : Monday, March 23, 2015 - 6:56:46 PM

Identifiers

  • HAL Id : tel-01097763, version 1

Collections

Citation

Julian Quiroga. Scene Flow Estimation from RGBD Images. Computer Vision and Pattern Recognition [cs.CV]. Grenoble University, 2014. English. ⟨tel-01097763⟩

Share

Metrics

Record views

480

Files downloads

833