Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs

Abstract : The cast shadows in an image provide important information about illumination and geometry. In this paper, we utilize this information in a novel framework in order to jointly recover the illumination environment, a set of geometry parameters, and an estimate of the cast shadows in the scene given a single image and coarse initial 3D geometry. We model the interaction of illumination and geometry in the scene and associate it with image evidence for cast shadows using a higher order Markov Random Field (MRF) illumination model, while we also introduce a method to obtain approximate image evidence for cast shadows. Capturing the interaction between light sources and geometry in the proposed graphical model necessitates higher order cliques and continuous-valued variables, which make inference challenging. Taking advantage of domain knowledge, we provide a two-stage minimization technique for the MRF energy of our model. We evaluate our method in different datasets, both synthetic and real. Our model is robust to rough knowledge of geometry and inaccurate initial shadow estimates, allowing a generic coarse 3D model to represent a whole class of objects for the task of illumination estimation, or the estimation of geometry parameters to refine our initial knowledge of scene geometry, simultaneously with illumination estimation.
Document type :
Journal articles
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00855591
Contributor : Enzo Ferrante <>
Submitted on : Thursday, August 29, 2013 - 4:09:28 PM
Last modification on : Tuesday, March 5, 2019 - 3:34:02 PM

Identifiers

Collections

Citation

A. Panagopoulos, Chaohui Wang, Dimitris Samaras, Nikos Paragios. Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (2), pp.437-449. 〈10.1109/TPAMI.2012.110〉. 〈hal-00855591〉

Share

Metrics

Record views

296