Skip to Main content Skip to Navigation
Conference papers

Camera Relocalization with Ellipsoidal Abstraction of Objects

Vincent Gaudillière 1 Gilles Simon 1 Marie-Odile Berger 1
1 MAGRIT-POST - Augmentation visuelle d'environnements complexes
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
Abstract : We are interested in AR applications which take place in man-made GPS-denied environments, as industrial or indoor scenes. In such environments, relocalization may fail due to repeated patterns and large changes in appearance which occur even for small changes in viewpoint. We investigate in this paper a new method for relocalization which operates at the level of objects and takes advantage of the impressive progress realized in object detection. Recent works have opened the way towards object oriented reconstruction from elliptic approximation of objects detected in images. We go one step further and propose a new method for pose computation based on ellipse/ellipsoid correspondences. We consider in this paper the practical common case where an initial guess of the rotation matrix of the pose is known, for instance with an inertial sensor or from the estimation of orthogonal vanishing points. Our contributions are twofold: we prove that a closed-form estimate of the translation can be computed from one ellipse-ellipsoid correspondence. The accuracy of the method is assessed on the LINEMOD database using only one correspondence. Second, we prove the effectiveness of the method on real scenes from a set of object detections generated by YOLO. A robust framework that is able to choose the best set of hypotheses is proposed and is based on an appropriate estimation of the reprojection error of ellipsoids. Globally, considering pose at the level of object allows us to avoid common failures due to repeated structures. In addition, due to the small combinatory induced by object correspondences, our method is well suited to fast rough localization even in large environments.
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download


https://hal.archives-ouvertes.fr/hal-02170784
Contributor : Vincent Gaudilliere <>
Submitted on : Tuesday, July 2, 2019 - 1:41:35 PM
Last modification on : Tuesday, January 7, 2020 - 8:53:54 AM

Files

ISMAR2019_paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02170784, version 1

Collections

Citation

Vincent Gaudillière, Gilles Simon, Marie-Odile Berger. Camera Relocalization with Ellipsoidal Abstraction of Objects. ISMAR 2019 - 18th IEEE International Symposium on Mixed and Augmented Reality, Oct 2019, Beijing, China. pp.19-29. ⟨hal-02170784⟩

Share

Metrics

Record views

219

Files downloads

975