Skip to Main content Skip to Navigation
Journal articles

$M^3\text{Fusion}$ : A Deep Learning Architecture for Multiscale Multimodal Multitemporal Satellite Data Fusion

Abstract : Modern Earth Observation systems provide remote sensing data at different temporal and spatial resolutions. Among all the available spatial mission, today the Sentinel-2 program supplies high temporal (every five days) and high spatial resolution (HSR) (10 m) images that can be useful to monitor land cover dynamics. On the other hand, very HSR (VHSR) imagery is still essential to figure out land cover mapping characterized by fine spatial patterns. Understanding how to jointly leverage these complementary sources in an efficient way when dealing with land cover mapping is a current challenge in remote sensing. With the aim of providing land cover mapping through the fusion of multitemporal HSR and VHSR satellite images, we propose a suitable end-to-end deep learning framework, namely M3Fusion , which is able to simultaneously leverage the temporal knowledge contained in time series data as well as the fine spatial information available in VHSR images. Experiments carried out on the Reunion Island study area confirm the quality of our proposal considering both quantitative and qualitative aspects.
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01931466
Contributor : Dino Ienco <>
Submitted on : Wednesday, March 20, 2019 - 11:01:43 AM
Last modification on : Wednesday, May 20, 2020 - 9:29:13 PM
Document(s) archivé(s) le : Friday, June 21, 2019 - 1:38:49 PM

File

1803.01945.pdf
Files produced by the author(s)

Identifiers

Citation

Paola Benedetti, Dino Ienco, Raffaele Gaetano, Kenji Ose, Ruggero Pensa, et al.. $M^3\text{Fusion}$ : A Deep Learning Architecture for Multiscale Multimodal Multitemporal Satellite Data Fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, IEEE, 2018, 11 (12), pp.4939-4949. ⟨10.1109/JSTARS.2018.2876357⟩. ⟨hal-01931466⟩

Share

Metrics

Record views

471

Files downloads

1174