User Assisted Intrinsic Images

Adrien Bousseau (1) , Sylvain Paris (2) , Frédo Durand (3)

1 ARTIS - Acquisition, representation and transformations for image synthesis
2 Adobe Advanced Technology Labs - Adobe Systems Inc.
3 MIT - Massachusetts Institute of Technology

For many computational photography applications, the lighting and materials in the scene are critical pieces of information. We seek to obtain intrinsic images, which decompose a photo into the product of an illumination component that represents lighting effects and a reflectance component that is the color of the observed material. This is an under-constrained problem and automatic methods are challenged by complex natural images. We describe a new approach that enables users to guide an optimization with simple indications such as regions of constant reflectance or illumination. Based on a simple assumption on local reflectance distributions, we derive a new propagation energy that enables a closed form solution using linear least-squares. We achieve fast performance by introducing a novel downsampling that preserves local color distributions. We demonstrate intrinsic image decomposition on a variety of images and show applications.

Mots clés: Computational photography; intrinsic images; reflectance illumination separation

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]

Adrien Bousseau, Sylvain Paris, Frédo Durand. User Assisted Intrinsic Images. ACM Transactions on Graphics, 2009, Proceedings of SIGGRAPH Asia 2009, 28 (5). ⟨inria-00413588v1⟩