Beyond RGB: Very High Resolution Urban Remote Sensing With Multimodal Deep Networks

Nicolas Audebert 1, 2 Bertrand Le Saux 2 Sébastien Lefèvre 1
1 OBELIX - Environment observation with complex imagery
UBS - Université de Bretagne Sud, IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and multi-scale remote sensing data for semantic labeling. Our contributions are threefold: a) we present an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, b) we investigate early and late fusion of Lidar and multispectral data, c) we validate our methods on two public datasets with state-of-the-art results. Our results indicate that late fusion make it possible to recover errors steaming from ambiguous data, while early fusion allows for better joint-feature learning but at the cost of higher sensitivity to missing data.
Type de document :
Article dans une revue
ISPRS Journal of Photogrammetry and Remote Sensing, Elsevier, In press, 〈10.1016/j.isprsjprs.2017.11.011〉
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-01636145
Contributeur : Nicolas Audebert <>
Soumis le : jeudi 23 novembre 2017 - 13:52:33
Dernière modification le : mercredi 16 mai 2018 - 11:24:08

Fichiers

elsarticle-template-1-num.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Nicolas Audebert, Bertrand Le Saux, Sébastien Lefèvre. Beyond RGB: Very High Resolution Urban Remote Sensing With Multimodal Deep Networks. ISPRS Journal of Photogrammetry and Remote Sensing, Elsevier, In press, 〈10.1016/j.isprsjprs.2017.11.011〉. 〈hal-01636145〉

Partager

Métriques

Consultations de la notice

900

Téléchargements de fichiers

429