Skip to Main content Skip to Navigation
Journal articles

Automatic Spatially Varying Illumination Recovery of Indoor Scenes Based on a Single RGB-D Image

Abstract : We propose an automatic framework to recover the illumination of indoor scenes based on a single RGB-D image. Unlike previous works, our method can recover spatially varying illumination without using any lighting capturing devices or HDR information. The recovered illumination can produce realistic rendering results. To model the geometry of the visible and invisible parts of scenes corresponding to the input RGB-D image, we assume that all objects shown in the image are located in a box with six faces and build a geometry model based on the depth map. We then present a confidence-scoring based strategy to separate the light sources from the highlight areas. The positions of light sources both in and out of the camera's view are calculated based on the classification result and the recovered geometry model. Finally, an iterative procedure is proposed to calculate the colors of light sources and the materials in the scene. In addition, a data-driven method is used to set constraints on the light source intensities. Using the estimated light sources and geometry model, environment maps at different points in the scene are generated that can model the spatial variance of illumination. The experimental results demonstrate the validity of our approach.
Complete list of metadatas

Cited literature [33 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01907554
Contributor : Xavier Granier <>
Submitted on : Thursday, November 15, 2018 - 10:51:21 AM
Last modification on : Thursday, April 9, 2020 - 3:48:02 PM
Document(s) archivé(s) le : Saturday, February 16, 2019 - 1:36:02 PM

File

TVCG_2018.pdf
Files produced by the author(s)

Identifiers

Citation

Guanyu Xing, Yanli Liu, Haibin Ling, Xavier Granier, Yanci Zhang. Automatic Spatially Varying Illumination Recovery of Indoor Scenes Based on a Single RGB-D Image. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2020, 26 (4), pp.1672 - 1685. ⟨10.1109/TVCG.2018.2876541⟩. ⟨hal-01907554⟩

Share

Metrics

Record views

231

Files downloads

193