Efficient Multi-Strategy Intra Prediction for Quality Scalable High Efficiency Video Coding

Dayong Wang (1) , Ce Zhu (2) , Yu Sun (3) , Frederic Dufaux (4) , Yuanyuan Huang (2)

1 Chongqing University of Posts and Telecommunications
2 UESTC - University of Electronic Science and Technology of China [Chengdu]
3 UCA - University of Central Arkansas
4 L2S - Laboratoire des signaux et systèmes

As an extension of High Efficiency Video Coding (HEVC), the Scalable High Efficiency Video Coding (SHVC) introduces multiple layers with inter-layer predictions, which greatly increases the complexity on top of the already complicated HEVC encoder. In Intra prediction for Quality SHVC, Coding Tree Unit (CTU) allows recursive splitting into four depth levels, which considers 35 Intra prediction modes and inter-layer reference (ILR) mode to determine the best possible mode at each depth level. This achieves the highest coding efficiency but incurs a substantially high computational complexity. In this paper, we propose a novel Intra prediction scheme to effectively speed up the enhancement layer Intra-coding in Quality SHVC. The new features of the proposed framework include: First, spatial correlation and its correlation degree are combined to predict most probable depth level candidates. Second, for a given depth candidate, based on the probabilities of ILR mode, we check the ILR mode by examining the residual distribution based on skewness and kurtosis to determine whether the residuals follow a Gaussian distribution. In that case, the Intra prediction comparisons, which require a high complexity, are skipped. Third, during Intra prediction selection from 35 Intra prediction modes, spatial and inter-layer correlations are combined with the local monotonicity of the Hadamard costs associated with the modes in a small neighborhood, to examine only a portion of Intra prediction modes. Finally, a hypothesis testing on the currently selected depth level is performed to examine whether the residuals present significant differences within their block to early terminate depth selection. The proposed multi-step multistrategy scheme aims to minimize the number of depth selections while greatly reducing the mode decision complexity for a depth candidate in a hierarchical fashion. Our experimental results demonstrate that the proposed scheme can achieve a speedup gain of more than 75% in average on the test video sequences, while maintaining almost the same coding efficiency.

Mots clés: Intra prediction; SHVC; complexity; depth decision; mode decision

Domaines: Traitement des images [eess.IV]; Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Dayong Wang, Ce Zhu, Yu Sun, Frederic Dufaux, Yuanyuan Huang. Efficient Multi-Strategy Intra Prediction for Quality Scalable High Efficiency Video Coding. IEEE Transactions on Image Processing, 2019, 28 (4), pp.2063 - 2074. ⟨10.1109/TIP.2017.2740161⟩. ⟨hal-01572623⟩