Facade Proposals for Urban Augmented Reality

Antoine Fond 1 Marie-Odile Berger 1 Gilles Simon 1
1 MAGRIT - Visual Augmentation of Complex Environments
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
Abstract : We introduce a novel object proposals method specific to building facades. We define new image cues that measure typical facade characteristics such as semantic, symmetry and repetitions. They are combined to generate a few facade candidates in urban environments fast. We show that our method outperforms state-of-the-art object proposals techniques for this task on the 1000 images of the Zurich Building Database. We demonstrate the interest of this procedure for augmented reality through facade recognition and camera pose initialization. In a very time-efficient pipeline we classify the candidates and match them to a facade references database using CNN-based descriptors. We prove that this approach is more robust to severe changes of viewpoint and occlusions than standard object recognition methods.
Type de document :
Communication dans un congrès
ISMAR 2017 - 16th IEEE International Symposium on Mixed and Augmented Reality, Oct 2017, Nantes, France
Liste complète des métadonnées

Littérature citée [29 références]  Voir  Masquer  Télécharger

Contributeur : Gilles Simon <>
Soumis le : vendredi 14 juillet 2017 - 16:00:35
Dernière modification le : mardi 18 décembre 2018 - 16:18:26
Document(s) archivé(s) le : vendredi 26 janvier 2018 - 21:44:30


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01562392, version 1


Antoine Fond, Marie-Odile Berger, Gilles Simon. Facade Proposals for Urban Augmented Reality. ISMAR 2017 - 16th IEEE International Symposium on Mixed and Augmented Reality, Oct 2017, Nantes, France. 〈hal-01562392〉



Consultations de la notice


Téléchargements de fichiers