Rate-Distortion Optimized Super-Ray Merging for Light Field Compression

Xin Su 1 Mira Rizkallah 1 Thomas Maugey 1 Christine Guillemot 1
1 Sirocco - Analysis representation, compression and communication of visual data
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper, we focus on the problem of compressing dense light fields which represent very large volumes of highly redundant data. In our scheme, view synthesis based on convolutional neural networks (CNN) is used as a first prediction step to exploit interview correlation. Super-rays are then constructed to capture the interview and spatial redundancy remaining in the prediction residues. To ensure that the super-ray segmentation is highly correlated with the residues to be encoded, the super-rays are computed on synthesized residues (the difference between the four transmitted corner views and their corresponding synthesized views), instead of the synthesized views. Neighboring super-rays are merged into a larger super-ray according to a rate-distortion cost. A 4D shape adaptive discrete cosine transform (SA-DCT) is applied per super-ray on the prediction residues in both the spatial and angular dimensions. A traditional coding scheme consisting of quantization and entropy coding is then used for encoding the transformed coefficients. Experimental results show that the proposed coding scheme outperforms HEVC-based schemes at low bitrate.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01812858
Contributor : Christine Guillemot <>
Submitted on : Monday, June 11, 2018 - 9:10:17 PM
Last modification on : Friday, September 13, 2019 - 9:50:02 AM
Long-term archiving on: Wednesday, September 12, 2018 - 8:03:47 PM

File

LFCompression_SA_DCT-1.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01812858, version 1

Citation

Xin Su, Mira Rizkallah, Thomas Maugey, Christine Guillemot. Rate-Distortion Optimized Super-Ray Merging for Light Field Compression. EUSIPCO 2018 - 26th European Signal Processing Conference, Sep 2018, Rome, Italy. pp.1-5. ⟨hal-01812858⟩

Share

Metrics

Record views

534

Files downloads

376