Fusion of IR and Visible Light Modalities for Face Recognition

Pierre Buyssens (1, 2) , Marinette Revenu (1) , Olivier Lepetit (2)

1 Equipe Image - Laboratoire GREYC - UMR6072
2 FT R&D - France Télécom Recherche & Développement

We present a low resolution face recognition technique based on a special type of convolutional neural network which is trained to extract facial features from face images and project them onto a low-dimensional space. The network is trained to reconstruct a reference image chosen beforehand, and it has been applied in visible and infrared light. Since the learning phase is achieved separately for the two modalities, the projections, and then the new spaces, are uncorrelated for the two networks. However, by normalizing the results of these two non-linear approaches, we can merge them according to a measure of saliency computed dynamically. We experimentally show that our approach obtain good results in terms of precision and robustness, especially on new and unseen subjects.

Mots clés: Face recognition; Feature extraction; Neural nets

Domaines: Traitement des images [eess.IV]; Apprentissage [cs.LG]

Pierre Buyssens, Marinette Revenu, Olivier Lepetit. Fusion of IR and Visible Light Modalities for Face Recognition. BTAS, Sep 2009, Washington DC, United States. pp.1-6, ⟨10.1109/BTAS.2009.5339031⟩. ⟨hal-00805793⟩