Skip to Main content Skip to Navigation
New interface

Scene Flow Estimation from RGBD Images

Julian Quiroga 1, 2 
2 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : This thesis addresses the problem of reliably recovering a 3D motion field, or scene flow, from a temporal pair of RGBD images. We propose a semi-rigid estimation framework for the robust computation of scene flow, taking advantage of color and depth information, and an alternating variational minimization framework for recovering rigid and non-rigid components of the 3D motion field. Previous attempts to estimate scene flow from RGBD images have extended optical flow approaches without fully exploiting depth data or have formulated the estimation in 3D space disregarding the semi-rigidity of real scenes. We demonstrate that scene flow can be robustly and accurately computed in the image domain by solving for 3D motions consistent with color and depth, encouraging an adjustable combination between local and piecewise rigidity. Additionally, we show that solving for the 3D motion field can be seen as a specific case of a more general estimation problem of a 6D field of rigid motions. Accordingly, we formulate scene flow estimation as the search of an optimal field of twist motions achieving state-of-the-art results.
Complete list of metadata

Cited literature [81 references]  Display  Hide  Download
Contributor : Julian Quiroga Connect in order to contact the contributor
Submitted on : Monday, December 22, 2014 - 4:28:49 PM
Last modification on : Wednesday, July 6, 2022 - 4:13:52 AM
Long-term archiving on: : Monday, March 23, 2015 - 6:56:46 PM


  • HAL Id : tel-01097763, version 1



Julian Quiroga. Scene Flow Estimation from RGBD Images. Computer Vision and Pattern Recognition [cs.CV]. Grenoble University, 2014. English. ⟨NNT : ⟩. ⟨tel-01097763⟩



Record views


Files downloads