Skip to Main content Skip to Navigation
Journal articles

Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images

Nicolas Audebert 1, 2 Bertrand Le Saux 1 Sébastien Lefèvre 2
2 OBELIX - Environment observation with complex imagery
UBS - Université de Bretagne Sud, IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Like computer vision before, remote sensing has been radically changed by the introduction of deep learning and, more notably, Convolution Neural Networks. Land cover classification, object detection and scene understanding in aerial images rely more and more on deep networks to achieve new state-of-the-art results. Recent architectures such as Fully Convolutional Networks can even produce pixel level annotations for semantic mapping. In this work, we present a deep-learning based segment-before-detect method for segmentation and subsequent detection and classification of several varieties of wheeled vehicles in high resolution remote sensing images. This allows us to investigate object detection and classification on a complex dataset made up of visually similar classes, and to demonstrate the relevance of such a subclass modeling approach. Especially, we want to show that deep learning is also suitable for object-oriented analysis of Earth Observation data as effective object detection can be obtained as a byproduct of accurate semantic segmentation. First, we train a deep fully convolutional network on the ISPRS Potsdam and the NZAM/ONERA Christchurch datasets and show how the learnt semantic maps can be used to extract precise segmentation of vehicles. Then, we show that those maps are accurate enough to perform vehicle detection by simple connected component extraction. This allows us to study the repartition of vehicles in the city. Finally, we train a Convolutional Neural Network to perform vehicle classification on the VEDAI dataset, and transfer its knowledge to classify the individual vehicle instances that we detected.
Document type :
Journal articles
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01529624
Contributor : Véronique Soullier <>
Submitted on : Wednesday, November 13, 2019 - 5:53:16 PM
Last modification on : Saturday, July 11, 2020 - 3:14:13 AM

File

rs2017audebert.pdf
Files produced by the author(s)

Identifiers

Citation

Nicolas Audebert, Bertrand Le Saux, Sébastien Lefèvre. Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images. Remote Sensing, MDPI, 2017, 9 (4), page 1-18. ⟨10.3390/rs9040368⟩. ⟨hal-01529624⟩

Share

Metrics

Record views

1231

Files downloads

408