HEVC saliency map computation

Abstract : This paper investigates whether the information related to the human visual saliency is still preserved at the level of the HEVC compressed stream syntax elements. In this respect, a new saliency model, matched to the peculiarities of this emerging standard is defined. It consists of four elementary maps, describing the four main saliency features: intensity, color, orientation and motion. These maps are defined based on the energies of the luma and chroma coefficients, on the variations of the intra prediction modes and on the energy of motion vectors, respectively. They are fusioned according to 48 static and static-dynamic pooling formulas. The results are compared to three state-of-the-art uncompressed (pixel) domain as well as to the MPEG-4 AVC compressed domain saliency maps. It is brought to light that the HEVC saliency model outperforms (with singular exceptions) the state-of-the-art uncompressed domain and is as good as MPEG-4 AVC saliency model. We can thus state that, as its MPEG-4 AVC ancestor, although not designed based upon visual saliency principles, the HEVC compression standard preserves this human visual property at the level of its syntax elements
Document type :
Conference papers
Complete list of metadatas

Contributor : Médiathèque Télécom Sudparis & Institut Mines-Télécom Business School <>
Submitted on : Wednesday, February 1, 2017 - 4:25:40 PM
Last modification on : Thursday, January 16, 2020 - 1:14:05 AM



Marwa Ammar, Mihai Mitrea, Ismail Boujelbane, Patrick Le Callet. HEVC saliency map computation. ELECTRONIC IMAGING 2016 : Human Vision and Electronic Imaging XX, Feb 2016, San Francisco, United States. pp.HVEI-107 - 1-8, ⟨10.2352/ISSN.2470-1173.2016.16.HVEI-107⟩. ⟨hal-01452180⟩



Record views