Learning Invariant Color Features with Sparse Topographic Restricted Boltzmann Machines

Hanlin Goh (1, 2, 3) , Kuśmierz Łukasz (2) , Joo-Hwee Lim (2, 3) , Nicolas Thome (1) , Matthieu Cord (1)

1 MALIRE - Machine Learning and Information Retrieval
2 Institute for Infocomm Research - I²R [Singapore]
3 IPAL - Image & Pervasive Access Lab

Our objective is to learn invariant color features directly from data via unsupervised learning. In this paper, we introduce a method to regularize restricted Boltzmann machines during training to obtain features that are sparse and topographically organized. Upon analysis, the features learned are Gabor-like and demonstrate a coding of orientation, spatial position, frequency and color that vary smoothly with the topography of the feature map. There is also differentiation between monochrome and color filters, with some exhibiting color-opponent properties. We also found that the learned represen- tation is more invariant to affine image transformations and changes in illumination color.

Domaines: Traitement des images [eess.IV]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Hanlin Goh, Kuśmierz Łukasz, Joo-Hwee Lim, Nicolas Thome, Matthieu Cord. Learning Invariant Color Features with Sparse Topographic Restricted Boltzmann Machines. ICIP 2011 - IEEE International Conference on Image Processing, Sep 2011, Brussels, Belgium. pp.1241-1244, ⟨10.1109/ICIP.2011.6115657⟩. ⟨hal-00716053⟩