Skip to Main content Skip to Navigation
Conference papers

3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Re-lighting

Abstract : Acquiring High Dynamic Range (HDR) light-fields from several images with different exposures (sensor integration periods) has been widely considered for static camera positions. In this paper a new approach is proposed that enables 3D HDR environment maps to be acquired directly from a dynamic set of images in real-time. In particular a method will be proposed to use an RGB-D camera as a dynamic light-field sensor, based on a dense real-time 3D tracking and mapping approach, that avoids the need for a light-probe or the observation of reflective surfaces. The 6dof pose and dense scene structure will be estimated simultaneously with the observed dynamic range so as to compute the radiance map of the scene and fuse a stream of low dynamic range images (LDR) into an HDR image. This will then be used to create an arbitrary number of virtual omni-directional light-probes that will be placed at the positions where virtual augmented objects will be rendered. In addition, a solution is provided for the problem of automatic shutter variations in visual SLAM. Augmented reality results are provided which demonstrate real-time 3D HDR mapping, virtual light-probe synthesis and light source detection for rendering reflective objects with shadows seamlessly with the real video stream in real-time.
Complete list of metadatas

Cited literature [42 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01357357
Contributor : Andrew Comport <>
Submitted on : Wednesday, March 27, 2019 - 10:57:54 AM
Last modification on : Thursday, March 5, 2020 - 12:20:28 PM
Document(s) archivé(s) le : Friday, June 28, 2019 - 12:24:18 PM

File

ismar2013.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Maxime Meilland, Christian Barat, Andrew I. Comport. 3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Re-lighting. International Symposium on Mixed and Augmented Reality, Oct 2013, Adelaide, Australia. ⟨10.1109/ISMAR.2013.6671774⟩. ⟨hal-01357357⟩

Share

Metrics

Record views

288

Files downloads

182