Budget Restricted Incremental Learning with Pre-Trained Convolutional Neural Networks and Binary Associative Memories

Ghouthi Boukli Hacene (1, 2, 3) , Vincent Gripon (1, 2, 3) , Nicolas Farrugia (1, 2, 3) , Matthieu Arzel (1, 2, 3) , Michel Jezequel (1, 2, 3)

1 Lab-STICC_IMTA_CACS_IAS
2 IMT Atlantique - ELEC - Département Electronique
3 Lab-STICC - Laboratoire des sciences et techniques de l'information, de la communication et de la connaissance

Thanks to their ability to absorb large amounts of data, Convolutional Neural NetThanks to their ability to absorb large amounts of data, Convolutional Neural Networks (CNNs) have become state- of-the-art in numerous vision challenges, sometimes even on par with biological vision. They rely on optimization routines that typically require intensive computational power, thus the question of embedded architectures is a very active field of research. Of particular interest is the problem of incremental learning, where the device adapts to new observations or classes. To tackle this challenging problem, we propose to combine pre-trained CNNs with binary associative memories, using product random sampling as an intermediate between the two methods. The obtained architecture requires significantly less computational power and memory usage than existing counterparts. Moreover, using various challenging vision datasets we show that the proposed architecture is able to perform one-shot learning - and even use only a small portion of the dataset - while keeping very good accuracy.works (CNNs) have become state- of-the-art in numerous vision challenges, sometimes even on par with biological vision. They rely on optimisation routines that typically require intensive computational power, thus the question of embedded architectures is a very active field of research. Of particular interest is the problem of incremental learning, where the device adapts to new observations or classes. To tackle this challenging problem, we propose to combine pre-trained CNNs with binary associative memories, using product random sampling as an intermediate between the two methods. The obtained architecture requires significantly less computational power and memory usage than existing counterparts. Moreover, using various challenging vision datasets we show that the proposed architecture is able to perform one-shot learning - and even use only a small portion of the dataset - while keeping very good accuracy.

Mots clés: Incremental Learning; Transfer Learning; Convolutionnal Neural Neworks; Associative memory

Domaines: Apprentissage [cs.LG]; Traitement du signal et de l'image [eess.SP]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Electronique; Traitement du signal et de l'image [eess.SP]

Ghouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia, Matthieu Arzel, Michel Jezequel. Budget Restricted Incremental Learning with Pre-Trained Convolutional Neural Networks and Binary Associative Memories. SIPS 2017 : IEEE International Workshop on Signal Processing Systems, Oct 2017, Lorient, France. pp.1 - 4, ⟨10.1109/SiPS.2017.8109978⟩. ⟨hal-01656152⟩