Skip to Main content Skip to Navigation
Conference papers

Novelty detection for unsupervised continual learning in image sequences

Ruiqi Dai 1 Mathieu Lefort 2 Frédéric Armetta 2 Mathieu Guillermin 3 Stefan Duffner 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 SyCoSMA - Systèmes Cognitifs et Systèmes Multi-Agents
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Recent works in the domain of deep learning for object recognition on common image classification benchmarks often address the representation learning problem under the assumption of i.i.d. input data. Although achieving satisfying results, this assumption seems not realistic when agents have to learn autonomously. An autonomous agent receives a continual visual flow of objects which is far from an i.i.d. distribution of objects. Moreover, agents have to construct their representations of the world and adapt to unknown environments, without relying on external sources of information such as labels that would be provided post-classification and are unavoidable when an oversegmentation is done. Then, in order to exploit the learned representation effectively for object recognition, a clear and meaningful relationship w.r.t. real object categories is required, which has been largely neglected in existing unsupervised algorithms. In this paper, we propose a novelty detection method for continual and unsupervised object recognition, as an extension for the recent CURL model, which allows to moderate oversegmentation while preserving accuracy, in order to meet the requirements for autonomy. We experimentally validated our approach on two standard image classification benchmarks, MNIST and Fashion-MNIST, in this unsupervised and continual learning setting and improve the state of the art in terms of cluster purity, which is crucial for subsequent object recognition, since it facilitates clustering when information on ground truth labels is not available for free.
Complete list of metadata
Contributor : Stefan Duffner Connect in order to contact the contributor
Submitted on : Friday, December 3, 2021 - 4:39:30 PM
Last modification on : Friday, January 21, 2022 - 4:43:50 PM


Files produced by the author(s)


  • HAL Id : hal-03465146, version 1


Ruiqi Dai, Mathieu Lefort, Frédéric Armetta, Mathieu Guillermin, Stefan Duffner. Novelty detection for unsupervised continual learning in image sequences. IEEE International Conference on Tools with Artificial Intelligence (ICTAI), Nov 2021, Washington DC (virtual), United States. ⟨hal-03465146⟩



Les métriques sont temporairement indisponibles