Fusion of Range and Stereo Data for High-Resolution Scene-Modeling

Georgios Evangelidis 1, * Miles Hansard 2 Radu Horaud 1
* Corresponding author
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 School of Electronic Engineering and Computer Science
EECS - School of Electronic Engineering and Computer Science
Abstract : This paper addresses the problem of range-stereo fusion, for the construction of high-resolution depth maps. In particular, we combine low-resolution depth data with high-resolution stereo data, in a maximum a posteriori (MAP) formulation. Unlike existing schemes that build on MRF optimizers, we infer the disparity map from a series of local energy minimization problems that are solved hierarchically, by growing sparse initial disparities obtained from the depth data. The accuracy of the method is not compromised, owing to three properties of the data-term in the energy function. Firstly, it incorporates a new correlation function that is capable of providing refined correlations and disparities, via subpixel correction. Secondly, the correlation scores rely on an adaptive cost aggregation step, based on the depth data. Thirdly, the stereo and depth likelihoods are adaptively fused, based on the scene texture and camera geometry. These properties lead to a more selective growing process which, unlike previous seed-growing methods, avoids the tendency to propagate incorrect disparities. The proposed method gives rise to an intrinsically efficient algorithm, which runs at 3FPS on 2.0MP images on a standard desktop computer. The strong performance of the new method is established both by quantitative comparisons with state-of-the-art methods, and by qualitative comparisons using real depth-stereo data-sets.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [48 references]  Display  Hide  Download


https://hal.archives-ouvertes.fr/hal-01110031
Contributor : Team Perception <>
Submitted on : Tuesday, January 27, 2015 - 1:26:26 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:43 AM
Document(s) archivé(s) le : Tuesday, April 28, 2015 - 10:51:16 AM

Files

pami2015.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Georgios Evangelidis, Miles Hansard, Radu Horaud. Fusion of Range and Stereo Data for High-Resolution Scene-Modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2015, 37 (11), pp.2178 - 2192. ⟨http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7031946⟩. ⟨10.1109/TPAMI.2015.2400465⟩. ⟨hal-01110031⟩

Share

Metrics

Record views

1415

Files downloads

2010