Generic and Real Time Structure from Motion using Local Bundle Adjustment

Abstract : This paper describes a method for estimating the motion of a calibrated camera and the three dimensional geometry of the filmed environment. The only data used is video input. Interest points are tracked and matched between frames at video rate. Robust estimates of the camera motion are computed in real-time, key frames are selected to enable 3D reconstruction of the features. We introduce a local bundle adjustment allowing 3D points and camera poses to be refined simultaneously through the sequence. This significantly reduces computational complexity when compared with global bundle adjustment. This method is applied initially to a perspective camera model, then extended to a generic camera model to describe most existing kinds of cameras. Experiments performed using real world data provide evaluations of the speed and robustness of the method. Results are compared to the ground truth measured with a differential GPS. The generalized method is also evaluated experimentally, using three types of calibrated cameras: stereo rig, perspective and catadioptric.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [27 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01635634
Contributor : Maxime Lhuillier <>
Submitted on : Wednesday, November 15, 2017 - 2:45:13 PM
Last modification on : Thursday, February 7, 2019 - 4:21:37 PM
Document(s) archivé(s) le : Friday, February 16, 2018 - 1:13:48 PM

File

pIvc09.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01635634, version 1

Citation

E Mouragnon, Maxime Lhuillier, M Dhome, F Dekeyser, P Sayd. Generic and Real Time Structure from Motion using Local Bundle Adjustment. Image and Vision Computing, Elsevier, 2009, 27 (8), pp.1178-1193. ⟨hal-01635634⟩

Share

Metrics

Record views

169

Files downloads

228