An in-depth evaluation of multimodal video genre categorization

Ionut Mironica (1) , Bogdan Ionescu (2, 3) , Peter Knees (4) , Patrick Lambert (3)

1 LAPI - Laboratoire d'Analyse et Traitement d'Images
2 LAPI - Laboratorul de Analiza si Prelucrarea Imaginilor [Bucarest]
3 LISTIC - Laboratoire d'Informatique, Systèmes, Traitement de l'Information et de la Connaissance
4 Department of Computational Perception

In this paper we propose an in-depth evaluation of the performance of video descriptors to multimodal video genre categorization. We discuss the perspective of designing appropriate late fusion techniques that would enable to attain very high categorization accuracy, close to the one achieved with user-based text information. Evaluation is carried out in the context of the 2012 Video Genre Tagging Task of the MediaEval Benchmarking Initiative for Multimedia Evaluation, using a data set of up to 15.000 videos (3,200 hours of footage) and 26 video genre categories specific to web media. Results show that the proposed approach significantly improves genre categorization performance, outperforming other existing approaches. The main contribution of this paper is in the experimental part, several valuable interesting findings are reported that motivate further research on video genre classification.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Ionut Mironica, Bogdan Ionescu, Peter Knees, Patrick Lambert. An in-depth evaluation of multimodal video genre categorization. 11th International Workshop on Content-Based Multimedia Indexing (CBMI 2013), Jun 2013, Veszprem, Hungary. pp.11-16, ⟨10.1109/CBMI.2013.6576545⟩. ⟨hal-00875042⟩