Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Fine scale image registration in large-scale urban LIDAR point sets

Maximilien Guislain 1 Julie Digne 1 Raphaëlle Chaine 1 Gilles Monnier 2 
1 GeoMod - Modélisation Géométrique, Géométrie Algorithmique, Fractales
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Urban scenes acquisition is very often performed using laser scanners onboard a vehicle. In parallel, color information is also acquired through a set of coarsely aligned camera pictures. The question of combining both measures naturally arises for adding color to the 3D points or enhancing the geometry, but it faces important challenges. Indeed, 3D geometry acquisition is highly accurate while the images suffer from distortion and are only coarsely registered to the geometry. In this paper, we introduce a two-step method to register images to large-scale complex point clouds. Our method performs the image-to-geometry registration by iteratively registering the real image to a synthetic image obtained from the estimated camera pose and the point cloud, using either reflectance or normal information. First a coarse registration is performed by generating a wide-angle synthetic image and considering that small pitch and yaw rotations can be estimated as translations in the image plane. Then a fine registration is performed using a new image metric which is adapted to the difference of modality between the real and synthetic images. This new image metric is more resilient to missing data and large transformations than standard Mutual Information. In the process, we also introduce a method to generate synthetic images from a 3D point cloud that is adapted to large-scale urban scenes with occlusions and sparse areas. The efficiency of our algorithm is demonstrated both qualitatively and quantitatively on datasets of urban scans and associated images.
Document type :
Journal articles
Complete list of metadata

Cited literature [33 references]  Display  Hide  Download
Contributor : Julie Digne Connect in order to contact the contributor
Submitted on : Wednesday, June 28, 2017 - 10:04:33 PM
Last modification on : Tuesday, June 1, 2021 - 2:08:08 PM
Long-term archiving on: : Thursday, January 18, 2018 - 3:20:57 AM


Files produced by the author(s)



Maximilien Guislain, Julie Digne, Raphaëlle Chaine, Gilles Monnier. Fine scale image registration in large-scale urban LIDAR point sets. Computer Vision and Image Understanding, Elsevier, 2017, Special Issue on Large-Scale 3D Modeling of Urban Indoor or Outdoor Scenes from Images and Range Scans, 157, pp.90-102. ⟨10.1016/j.cviu.2016.12.004⟩. ⟨hal-01468091⟩



Record views


Files downloads