Energy-Based Models for Earth Observation Applications

Javiera Castillo-Navarro (1) , Bertrand Le Saux (2) , Alexandre Boulch (3) , Sébastien Lefèvre (1)

1 OBELIX - Observation de l’environnement par imagerie complexe
2 ESA - Agence Spatiale Européenne = European Space Agency
3 Valeo.ai

The large amount of data, available thanks to the recent sensors, have made possible the use of deep learning for Earth Observation. Yet, actual approaches tend to tackle one problem at a time, e.g. classification or image generation. We propose a new framework for Earth Observation images processing which learns an energy-based model to estimate the underlying distribution, possibly estimated using non-annotated images. On the varied image types of the EuroSAT benchmark, we show this model obtains classification results on par with state-of-the-art and moreover allows to tackle a high range of high-potential applications, from image synthesis to high performance semi-supervised learning.

Domaines: Traitement des images [eess.IV]

Javiera Castillo-Navarro, Bertrand Le Saux, Alexandre Boulch, Sébastien Lefèvre. Energy-Based Models for Earth Observation Applications. ICLR Workshop on Energy Based Models, 2021, Virtual, France. ⟨hal-03354935⟩