A Convolutional Neural Network Approach for Objective Video Quality Assessment - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Neural Networks Année : 2006

A Convolutional Neural Network Approach for Objective Video Quality Assessment

Résumé

This paper describes an application of neural networks in the field of objective measurement method designed to automatically assess the perceived quality of digital videos. This challenging issue aims to emulate human judgment and to replace very complex and time consuming subjective quality assessment. Several metrics have been proposed in literature to tackle this issue. They are based on a general framework that combines different stages, each of them addressing complex problems. The ambition of this paper is not to present a global perfect quality metric but rather to focus on an original way to use neural networks in such a framework in the context of reduced reference quality metric. Especially, we point out the interest of such a tool for combining features and pooling them in order to compute quality scores. The proposed approach solves some problems inherent to objective metrics that should predict subjective quality score obtained using the single stimulus continuous quality evaluation (SSCQE) method. This latter has been adopted by VQEG (Video Quality Expert Group) in its recently finalized RRNR-TV (Reduced Referenced and No Reference) test plan. The originality of such approach compared to previous attempts to use neural networks for quality assessment, relies on the use of a convolutional neural network (CNN) that allows a continuous time scoring of the video. Objective features are extracted on a frame-by-frame basis on both the reference and the distorted sequences, they are derived from a perceptual-based representation and integrated along the temporal axis using a Time Delay Neural Network (TDNN). Experiments conducted on different MPEG-2 videos, with bit rates ranging from 2 to 6 Mbits/s, show the effectiveness of the proposed approach to get a plausible model of temporal pooling from the human vision system (HVS) point of view. More specifically, a linear correlation criteria, between objective and subjective scoring, up to 0.92 has been obtained on a set of typical TV videos.
Fichier principal
Vignette du fichier
A_convolutional_neural_network_approach_for_objective_video_quality_assessment_completefinal_manuscript.pdf (386.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00287426 , version 1 (11-06-2008)

Identifiants

Citer

Patrick Le Callet, Christian Viard-Gaudin, Dominique Barba. A Convolutional Neural Network Approach for Objective Video Quality Assessment. IEEE Transactions on Neural Networks, 2006, 17 (5), pp.1316- 1327. ⟨10.1109/TNN.2006.879766⟩. ⟨hal-00287426⟩
573 Consultations
7163 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More