Skip to Main content Skip to Navigation
Journal articles

Deep online classification using pseudo-generative models

Andrey Besedin 1, 2 Pierre Blanchart 2 Michel Crucianu 1 Marin Ferecatu 1
1 CEDRIC - VERTIGO - CEDRIC. Données complexes, apprentissage et représentations
CEDRIC - Centre d'études et de recherche en informatique et communications
2 LADIS - Laboratoire d'analyse des données et d'intelligence des systèmes
DM2I - Département Métrologie Instrumentation & Information : DRT/LIST/DM2I
Abstract : In this work we propose a new deep learning based approach for online classification on streams of high-dimensional data. While requiring very little historical data storage, our approach is able to alleviate catastrophic forgetting in the scenario of continual learning with no assumption on the stationarity of the data in the stream. To make up for the absence of historical data, we propose a new generative autoencoder endowed with an auxiliary loss function that ensures fast task-sensitive convergence. To evaluate our approach we perform experiments on two well-known image datasets, MNIST and LSUN, in a continuous streaming mode. We extend the experiments to a large multi-class synthetic dataset that allows to check the performance of our method in more challenging settings with up to 1000 distinct classes. Our approach is able to perform classification on dynamic data streams with an accuracy close to the results obtained in the offline classification setup where all the data are available for the full duration of training. In addition, we demonstrate the ability of our method to adapt to unseen data classes and new instances of already known data categories, while avoiding catastrophic forgetting of previously acquired knowledge.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-02937546
Contributor : Michel Crucianu <>
Submitted on : Monday, September 14, 2020 - 10:27:28 AM
Last modification on : Friday, June 25, 2021 - 10:00:02 AM

Identifiers

Citation

Andrey Besedin, Pierre Blanchart, Michel Crucianu, Marin Ferecatu. Deep online classification using pseudo-generative models. Computer Vision and Image Understanding, Elsevier, 2020, 201, pp.103048. ⟨10.1016/j.cviu.2020.103048⟩. ⟨hal-02937546⟩

Share

Metrics

Record views

116