Cross-calibration of Time-of-flight and Colour Cameras

Miles Hansard 1 Georgios Evangelidis 2 Quentin Pelorson 2 Radu Horaud 2
2 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Time-of-flight cameras provide depth information, which is complementary to the photometric appearance of the scene in ordinary images. It is desirable to merge the depth and colour information, in order to obtain a coherent scene representation. However, the individual cameras will have different viewpoints, resolutions and fields of view, which means that they must be mutually calibrated. This paper presents a geometric framework for this multi-view and multi-modal calibration problem. It is shown that three-dimensional projective transformations can be used to align depth and parallax-based representations of the scene, with or without Euclidean reconstruction. A new evaluation procedure is also developed; this allows the reprojection error to be decomposed into calibration and sensor-dependent components. The complete approach is demonstrated on a network of three time-of-flight and six colour cameras. The applications of such a system, to a range of automatic scene-interpretation problems, are discussed.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas
Contributor : Team Perception <>
Submitted on : Monday, July 7, 2014 - 12:26:07 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:59 AM

Links full text


  • HAL Id : hal-01019668, version 1
  • ARXIV : 1401.8092



Miles Hansard, Georgios Evangelidis, Quentin Pelorson, Radu Horaud. Cross-calibration of Time-of-flight and Colour Cameras. 2014. ⟨hal-01019668⟩



Record views