An Image Rendering Pipeline for Focused Plenoptic Cameras

Matthieu Hog (1) , Neus Sabater (1) , Benoît Vandame (1) , Valter Drazic (1)

1 Technicolor R & I [Cesson Sévigné]

In this paper, we present a complete processing pipeline for focused plenoptic cameras. In particular, we propose (i) a new algorithm for microlens center calibration fully in the Fourier domain, (ii) a novel algorithm for depth map computation using a stereo focal stack and (iii) a depth-based rendering algorithm that is able to refocus at a particular depth or to create all-in-focus images. The proposed algorithms are fast, accurate and do not need to generate Subaperture Images (SAIs) or Epipolar Plane Images (EPIs) which is capital for focused plenoptic cameras. Also, the resolution of the resulting depth map is the same as the rendered image. We show results of our pipeline on the Georgiev's dataset and real images captured with different Raytrix cameras.

Mots clés: plenoptic cameras; calibration; depth estimation; refocusing

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Matthieu Hog, Neus Sabater, Benoît Vandame, Valter Drazic. An Image Rendering Pipeline for Focused Plenoptic Cameras. 2017. ⟨hal-01401501v2⟩