Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs

Abstract : The cast shadows in an image provide important information about illumination and geometry. In this paper, we utilize this information in a novel framework in order to jointly recover the illumination environment, a set of geometry parameters, and an estimate of the cast shadows in the scene given a single image and coarse initial 3D geometry. We model the interaction of illumination and geometry in the scene and associate it with image evidence for cast shadows using a higher order Markov Random Field (MRF) illumination model, while we also introduce a method to obtain approximate image evidence for cast shadows. Capturing the interaction between light sources and geometry in the proposed graphical model necessitates higher order cliques and continuous-valued variables, which make inference challenging. Taking advantage of domain knowledge, we provide a two-stage minimization technique for the MRF energy of our model. We evaluate our method in different datasets, both synthetic and real. Our model is robust to rough knowledge of geometry and inaccurate initial shadow estimates, allowing a generic coarse 3D model to represent a whole class of objects for the task of illumination estimation, or the estimation of geometry parameters to refine our initial knowledge of scene geometry, simultaneously with illumination estimation.
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (2), pp.437-449. 〈10.1109/TPAMI.2012.110〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00855591
Contributeur : Enzo Ferrante <>
Soumis le : jeudi 29 août 2013 - 16:09:28
Dernière modification le : jeudi 7 février 2019 - 17:29:11

Lien texte intégral

Identifiants

Collections

Citation

A. Panagopoulos, Wang Chaohui, Dimitris Samaras, Nikos Paragios. Simultaneous Cast Shadows, Illumination and Geometry Inference Using Hypergraphs. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2013, 35 (2), pp.437-449. 〈10.1109/TPAMI.2012.110〉. 〈hal-00855591〉

Partager

Métriques

Consultations de la notice

286