A Fourier Disparity Layer representation for Light Fields

Mikaël Le Pendu 1 Christine Guillemot 1 Aljosa Smolic 2
1 Sirocco - Analysis representation, compression and communication of visual data
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper, we present a new Light Field representation for efficient Light Field processing and rendering called Fourier Disparity Layers (FDL). The proposed FDL representation samples the Light Field in the depth (or equivalently the disparity) dimension by decomposing the scene as a discrete sum of layers. The layers can be constructed from various types of Light Field inputs, including a set of sub-aperture images, a focal stack, or even a combination of both. From our derivations in the Fourier domain, the layers are simply obtained by a regularized least square regression performed independently at each spatial frequency, which is efficiently parallelized in a GPU implementation. Our model is also used to derive a gradient descent-based calibration step that estimates the input view positions and an optimal set of disparity values required for the layer construction. Once the layers are known, they can be simply shifted and filtered to produce different viewpoints of the scene while controlling the focus and simulating a camera aperture of arbitrary shape and size. Our implementation in the Fourier domain allows real-time Light Field rendering. Finally, direct applications such as view interpolation or extrapolation and denoising are presented and evaluated.
Document type :
Journal articles
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02130555
Contributor : Christine Guillemot <>
Submitted on : Wednesday, May 15, 2019 - 7:52:36 PM
Last modification on : Tuesday, February 25, 2020 - 8:08:11 AM
Long-term archiving on: Monday, August 19, 2019 - 12:25:05 PM

File

Fourier_Disparity_Layers.pdf
Files produced by the author(s)

Identifiers

Citation

Mikaël Le Pendu, Christine Guillemot, Aljosa Smolic. A Fourier Disparity Layer representation for Light Fields. IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, In press, pp.5740 - 5753. ⟨10.1109/TIP.2019.2922099⟩. ⟨hal-02130555⟩

Share

Metrics

Record views

62

Files downloads

123