Skip to Main content Skip to Navigation
Journal articles

Deep online classification using pseudo-generative models

Andrey Besedin 1, 2 Pierre Blanchart 2 Michel Crucianu 1 Marin Ferecatu 1 
1 CEDRIC - VERTIGO - CEDRIC. Données complexes, apprentissage et représentations
CEDRIC - Centre d'études et de recherche en informatique et communications
2 LI3A - Intelligence Artificielle et Apprentissage Automatique
DM2I - Département Métrologie Instrumentation & Information : DRT/LIST/DM2I
Abstract : In this work we propose a new deep learning based approach for online classification on streams of high-dimensional data. While requiring very little historical data storage, our approach is able to alleviate catastrophic forgetting in the scenario of continual learning with no assumption on the stationarity of the data in the stream. To make up for the absence of historical data, we propose a new generative autoencoder endowed with an auxiliary loss function that ensures fast task-sensitive convergence. To evaluate our approach we perform experiments on two well-known image datasets, MNIST and LSUN, in a continuous streaming mode. We extend the experiments to a large multi-class synthetic dataset that allows to check the performance of our method in more challenging settings with up to 1000 distinct classes. Our approach is able to perform classification on dynamic data streams with an accuracy close to the results obtained in the offline classification setup where all the data are available for the full duration of training. In addition, we demonstrate the ability of our method to adapt to unseen data classes and new instances of already known data categories, while avoiding catastrophic forgetting of previously acquired knowledge.
Document type :
Journal articles
Complete list of metadata
Contributor : Michel CRUCIANU Connect in order to contact the contributor
Submitted on : Monday, June 13, 2022 - 2:28:10 PM
Last modification on : Friday, August 5, 2022 - 2:54:01 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2023-01-01

Please log in to resquest access to the document



Andrey Besedin, Pierre Blanchart, Michel Crucianu, Marin Ferecatu. Deep online classification using pseudo-generative models. Computer Vision and Image Understanding, Elsevier, 2020, 201, pp.103048. ⟨10.1016/j.cviu.2020.103048⟩. ⟨hal-02937546⟩



Record views