Sentinel-2 RGB and NIR bands simulation after fire events using a multi-temporal conditional generative adversarial network

Iris Dumeur (1) , Yang Chen (2) , Frédéric Sur (3) , Zheng-Shu Zhou (2)

1 ENSMN - Ecole Nationale Supérieure des Mines de Nancy
2 CSIRO Data61 [Sydney]
3 TANGRAM - Recalage visuel avec des modèles physiquement réalistes

In remote sensing applications, optical images are widely used to monitor land changes. However, clouds, haze, or smoke hide the area below and, therefore, limit the use of optical data to favorable weather conditions. Since the SAR signal can penetrate through clouds, haze, or smoke, it has been recently proposed to combine optical images and SAR data to overcome this limitation. In this report, we investigate a deep-learning model based on a multi-temporal conditional generative adversarial neural network that generates optical images from SAR data, based on optical cloudfree images and SAR data previously acquired. Quantitative and qualitative results over the region of Goulburn, Australia, are also provided to evaluate the effectiveness of this multi-temporal approach in monitoring vegetation changes after fire events. Software code is publicly available.

Mots clés: land monitoring; cloud haze or smoke removal; conditional generative adversarial neural network; multi-temporal SAR and optical data

Domaines: Traitement du signal et de l'image [eess.SP]; Ingénierie de l'environnement

Iris Dumeur, Yang Chen, Frédéric Sur, Zheng-Shu Zhou. Sentinel-2 RGB and NIR bands simulation after fire events using a multi-temporal conditional generative adversarial network. [Research Report] LORIA (Université de Lorraine, CNRS, INRIA). 2021. ⟨hal-03327421⟩