Fast Image Based Lighting for Mobile Realistic AR

Hadrien Croubois (1, 2) , Jean-Philippe Farrugia (2) , Jean-Claude Iehl (2)

1 ENS de Lyon - École normale supérieure de Lyon
2 R3AM - Rendu Réaliste pour la Réalité Augmentée Mobile

This paper presents a mobile implementation of realistic augmented reality using a simple image based lighting method. The front camera of the mobile device is used to interactively capture and update an environment map. Then, by making some reasonable assumptions on local geometry and object reflectance function, incident lighting is integrated in real-time. The method handles dynamic environment and soft shadows, and runs at real-time framerates on high-end devices.

Mots clés: augmented reality; virtual reality; real-time rendering; image-based lighting; environment acquisition

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement des images [eess.IV]

Hadrien Croubois, Jean-Philippe Farrugia, Jean-Claude Iehl. Fast Image Based Lighting for Mobile Realistic AR. [Research Report] LIRIS UMR CNRS 5205; ENS Lyon. 2014. ⟨hal-01534711⟩