Impact of the subjective dataset on the performance of image quality metrics

Abstract : The interest in objective quality assessment have significantly increased over the past decades. Several objective quality metrics have been proposed and made publicly available, moreover, several subjective quality assessment databases are distributed in order to evaluate and compare the metrics. However, several question arises: are the objective metrics behaviours constant across databases, contents and distortions? how significantly the subjective scores might fluctuate on different displays (i.e. CRT or LCD)? which objective quality metric might best evaluate a given distortion? In this article, we analyse the behaviour of four objective quality metrics (including PSNR) tested on three image databases. We demonstrate that the performances of the quality metrics can strongly fluctuate depending on the database used for testing. We also show the consistency of all metrics for two distinct displays.
Document type :
Conference papers
IEEE International Conference on Image Processing 2008. ICIP 2008., Oct 2008, San Diego, CA, United States. 2008
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-00321663
Contributor : Harold Mouchère <>
Submitted on : Monday, September 15, 2008 - 4:03:04 PM
Last modification on : Wednesday, June 24, 2015 - 11:00:12 AM
Document(s) archivé(s) le : Friday, June 4, 2010 - 11:22:22 AM

File

tourancheau-icip2008.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00321663, version 1

Collections

Citation

Sylvain Tourancheau, Florent Autrusseau, Parvez Sazzad, Yuukou Horita. Impact of the subjective dataset on the performance of image quality metrics. IEEE International Conference on Image Processing 2008. ICIP 2008., Oct 2008, San Diego, CA, United States. 2008. <hal-00321663>

Share

Metrics

Record views

319

Document downloads

190