Multimodal 2D Image to 3D Model Registration via a Mutual Alignment of Sparse and Dense Visual Features

Abstract : Many fields of application could benefit from an accurate registration of measurements of different modalities over a known 3D model. However, aligning a 2D image to a 3D model is a challenging task and is even more complex when the two have a different modality. Most of the 2D/3D registration methods are based on either geometric or dense visual features. Both have their own advantages and their own drawbacks. We propose, in this paper, to mutually exploit the advantages of one feature type to reduce the drawbacks of the other one. For this, an hybrid registration framework has been designed to mutually align geometrical and dense visual features in order to obtain an accurate final 2D/3D alignment. We evaluate and compare the proposed registration method on real data acquired by a robot equipped with several visual sensors. The results highlights the robustness of the method and its ability to produce wide convergence domain and a high registration accuracy.
Type de document :
Communication dans un congrès
IEEE International Conference on Robotics and Automation - ICRA,2018, May 2018, Brisbane, Australia
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01779176
Contributeur : Cédric Demonceaux <>
Soumis le : jeudi 26 avril 2018 - 14:35:46
Dernière modification le : vendredi 13 juillet 2018 - 11:56:01

Fichier

MultiModRegICRA18_FV.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01779176, version 1

Collections

Citation

Nathan Crombez, Ralph Seulin, Olivier Morel, David Fofi, Cédric Demonceaux. Multimodal 2D Image to 3D Model Registration via a Mutual Alignment of Sparse and Dense Visual Features. IEEE International Conference on Robotics and Automation - ICRA,2018, May 2018, Brisbane, Australia. 〈hal-01779176〉

Partager

Métriques

Consultations de la notice

131

Téléchargements de fichiers

83