Variational Uncalibrated Photometric Stereo under General Lighting

Bjoern Haefner (1) , Zhenzhang Ye (1) , Maolin Gao (2) , Tao Wu (1) , Yvain Quéau (3) , Daniel Cremers (1)

1 TUM - Technische Universität Munchen - Technical University Munich - Université Technique de Munich
2 Artisense
3 Equipe Image - Laboratoire GREYC - UMR6072

Photometric stereo (PS) techniques nowadays remain constrained to an ideal laboratory setup where modeling and calibration of lighting is amenable. This work aims to eliminate such restrictions. To this end, we introduce an efficient principled variational approach to uncalibrated PS under general illumination, which is approximated through a second-order spherical harmonic expansion. The joint recovery of shape, reflectance and illumination is formulated as a variational problem where shape estimation is carried out directly in terms of the underlying perspective depth map, thus implicitly ensuring integrability and bypassing the need for a subsequent normal integration. We provide a tailored numerical scheme to solve the resulting noncon-vex problem efficiently and robustly. On a variety of evaluations , our method consistently reduces the mean angular error by a factor of 2-3 compared to the state-of-the-art.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Bjoern Haefner, Zhenzhang Ye, Maolin Gao, Tao Wu, Yvain Quéau, et al.. Variational Uncalibrated Photometric Stereo under General Lighting. The IEEE International Conference on Computer Vision (ICCV 2019), Oct 2019, Seoul, South Korea. pp.8539-8548, ⟨10.1109/ICCV.2019.00863⟩. ⟨hal-02089403v2⟩