Affect in Multimedia: Benchmarking Violent Scenes Detection - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Affective Computing Année : 2020

Affect in Multimedia: Benchmarking Violent Scenes Detection

Résumé

In this paper, we report on the creation of a publicly available, common evaluation framework for Violent Scenes Detection (VSD) in Hollywood and YouTube videos. We propose a robust data set, the VSD96, with more than 96 hours of video of various genres, annotations at different levels of detail (e.g., shot-level, segment-level), annotations of mid-level concepts (e.g., blood, fire), various pre-computed multi-modal descriptors, and over 230 system output results as baselines. This is the most comprehensive data set available to this date tailored to the VSD task and was extensively validated during the MediaEval benchmarking campaigns. Furthermore, we provide an in-depth analysis of the crucial components of VSD algorithms, by reviewing the capabilities and the evolution of existing systems (e.g., overall trends and outliers, the influence of the employed features and fusion techniques, the influence of deep learning approaches). Finally, we discuss the possibility of going beyond state-of-the-art performance via an ad-hoc late fusion approach. Experimentation is carried out on the VSD96 data. We provide the most important lessons learned and gained insights. The increasing number of publications using the VSD96 data underline the importance of the topic. The presented and published resources are a practitioner's guide and also a strong baseline to overcome, which will help researchers for the coming years in analyzing aspects of audiovisual affect and violence detection in movies and videos.
Fichier principal
Vignette du fichier
VSD_TAC.pdf (2.36 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03032718 , version 1 (01-12-2020)

Identifiants

Citer

Mihai Gabriel Constantin, Liviu Daniel Stefan, Bogdan Ionescu, Claire-Helene Demarty, Mats Sjoberg, et al.. Affect in Multimedia: Benchmarking Violent Scenes Detection. IEEE Transactions on Affective Computing, 2020, ⟨10.1109/TAFFC.2020.2986969⟩. ⟨hal-03032718⟩
97 Consultations
228 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More