Skip to Main content Skip to Navigation
Journal articles

Toward Seamless Multi-view Scene Analysis From Satellite to Street-Level

Abstract : In this paper, we discuss and review how combined multi-view imagery from satellite to street-level can benefit scene analysis. Numerous works exist that merge information from remote sensing and images acquired from the ground for tasks such as object detection, robots guidance or scene understanding. What makes the combination of overhead and street-level images challenging are the strongly varying viewpoints, the different scales of the images, their illuminations and sensor modality and time of acquisition. Direct (dense) matching of images on a per-pixel basis is thus often impossible, and one has to resort to alternative strategies that will be discussed in this paper. For such purpose, we review recent works that attempt to combine images taken from the ground and overhead views for purposes like scene registration, reconstruction, or classification. After the theoretical review, we present three recent methods to showcase the interest and potential impact of such fusion on real applications (change detection, image orientation, and tree cataloging), whose logic can then be re-used to extend the use of ground based images in remote sensing and vice-versa. Through this review, we advocate that cross-fertilization between remote sensing, computer vision and machine learning is very valuable to make the best of geographic data available from Earth Observation sensors and ground imagery. Despite its challenges, we believe that integrating these complementary data sources will lead to major breakthroughs in Big GeoData. It will open new perspectives for this exciting and emerging field.
Document type :
Journal articles
Complete list of metadatas

Cited literature [88 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01672849
Contributor : Sébastien Lefèvre <>
Submitted on : Wednesday, November 13, 2019 - 6:45:16 PM
Last modification on : Friday, June 5, 2020 - 10:04:02 AM

File

pieee2017.pdf
Files produced by the author(s)

Identifiers

Citation

Sébastien Lefèvre, Devis Tuia, Jan Dirk Wegner, Timothee Produit, Ahmed Samy Nassaar. Toward Seamless Multi-view Scene Analysis From Satellite to Street-Level. Proceedings of the IEEE, Institute of Electrical and Electronics Engineers, 2017, 105 (10), pp.1884 - 1899. ⟨10.1109/JPROC.2017.2684300⟩. ⟨hal-01672849⟩

Share

Metrics

Record views

929

Files downloads

271