Handling Missing Data in the Computation of 3D Affine Transformations

Hanna Martisson (1) , Adrien Bartoli (2) , François Gaspard (1) , Jean-Marc Lavest (2)

1 LIST (CEA) - Laboratoire d'Intégration des Systèmes et des Technologies
2 LASMEA - Laboratoire des sciences et matériaux pour l'électronique et d'automatique

The reconstruction of rigid scenes from multiple images is a central topic in computer vision. Approaches merging partial 3D models in a hierarchical manner have proven the most eective to deal with large image sequences. One of the key building blocks of these hierarchical approaches is the alignment of two partial 3D models, which requires to express them in the same 3D coordinate frame by computing a 3D transformation. This problem has been well-studied for the cases of 3D models obtained with calibrated or uncalibrated pinhole cameras. We tackle the problem of aligning 3D models { sets of 3D points { obtained using uncalibrated ane cameras. This requires to estimate 3D ane transformations between the models. We propose a factorizationbased algorithm estimating simultaneously the aligning transformations and corrected points, exactly matching the estimated transformations, such that the reprojection error over all cameras is minimized. In the case of incomplete image data our algorithm uses an Expectation Maximization (EM) based scheme that alternates prediction of the missing data and estimation of the ane transformation. We experimentally compare our algorithm to other methods using simulated and real data.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Hanna Martisson, Adrien Bartoli, François Gaspard, Jean-Marc Lavest. Handling Missing Data in the Computation of 3D Affine Transformations. IAPR International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, 2005, United States. ⟨hal-00094758⟩