A full photometric and geometric model for attached webcam/matte screen devices

Yvain Quéau (1) , Richard Modrzejewski (2) , Pierre Gurdjos (1, 3) , Jean-Denis Durou (1)

1 IRIT-REVA - Real Expression Artificial Life
2 IRIT - Institut de recherche en informatique de Toulouse
3 CNRS - Centre National de la Recherche Scientifique

We present a thorough photometric and geometric study of the multimedia devices composed of both a matte screen and an attached camera, where it is shown that the light emitted by an image displayed on the monitor can be expressed in closed-form at any point facing the screen, and that the geometric calibration of the camera attached to the screen can be simplified by introducing simple geometric constraints. These theoretical contributions are experimentally validated in a photometric stereo application with extended sources, where a colored scene is reconstructed while watching a collection of graylevel images displayed on the screen, providing a cheap and entertaining way to acquire realistic 3D-representations for, e.g., augmented reality.

Mots clés: Photometric stereo; Lighting; Extended sources; Camera calibration

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]; Traitement du signal et de l'image [eess.SP]; Traitement des images [eess.IV]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Intelligence artificielle [cs.AI]

Yvain Quéau, Richard Modrzejewski, Pierre Gurdjos, Jean-Denis Durou. A full photometric and geometric model for attached webcam/matte screen devices. Signal Processing: Image Communication, 2016, 40, pp.65-81. ⟨10.1016/j.image.2015.11.006⟩. ⟨hal-01273010⟩