Edge-based multi-modal registration and application for night vision devices

Abstract : Multi-modal image sequence registration is a challenging problem that consists in aligning two image sequences of the same scene acquired with a different sensor, hence containing different characteristics. We focus in this paper on the registration of optical and infra-red image sequences acquired during the flight of a helicopter. Both cameras are located at different positions and they provide complementary informations. We propose a fast registration method based on the edge information: a new criterion is defined in order to take into account both the magnitude and the orientation of the edges of the images to register. We derive a robust technique based on a gradient ascent and combined with a reliability test in order to quickly determine the optimal transformation that matches the two image sequences. We show on real multi-modal data that our method outperforms classical registration methods, thanks to the shape information provided by the contours. Besides, results on synthetic images and real experimental conditions show that the proposed algorithm manages to find the optimal transformation in few iterations, achieving a rate of about 8 frames per second.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [27 references]  Display  Hide  Download

Contributor : Camille Sutour <>
Submitted on : Thursday, April 2, 2015 - 5:18:09 PM
Last modification on : Thursday, January 11, 2018 - 6:21:22 AM
Document(s) archivé(s) le : Tuesday, April 18, 2017 - 9:38:14 AM


Files produced by the author(s)




Camille Sutour, Jean-François Aujol, Charles-Alban Deledalle, Baudouin Denis de Senneville. Edge-based multi-modal registration and application for night vision devices. Journal of Mathematical Imaging and Vision, Springer Verlag, 2015, pp.1-20. ⟨10.1007/s10851-014-0554-8⟩. ⟨hal-01068431v2⟩



Record views


Files downloads