A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling

Abstract : Video summarization has been a core problem to manage the growing amount of content in multimedia databases. An efficient video summary should display an overview of the video content and most existing approaches fulfill this goal. However, such an overview does not allow the user to reach all details of interest selectively and progressively. This paper proposes a novel scalable summary generation approach based on the On-Line Analytical Processing data cube. Such a structure integrates tools like the drill down operation allowing to browse efficiently multiple descriptions of a dataset according to increased levels of detail. We adapt this model to video summary generation by expressing a video within a cross-media feature space and by performing clusterings according to particular subspaces. Consensus clustering is used to guide the subspace selection strategy at small dimensions, as the novelty brought by the least consensual subspaces is interesting for the refinements of a summary. Our approach is designed for weakly-structured contents such as cultural documentaries. We perform its evaluation on a corpus of cultural archives provided by the French Audiovisual National Institute (INA) using information retrieval metrics handling single and multiple reference annotations. The performances obtained overall improved results compared to two baseline systems performing random and arbitrary segmentations, showing a better balance between Precision and Recall.
Type de document :
Article dans une revue
Multimedia Tools and Applications, Springer Verlag, 2015, Multimedia Tools and Applications, 75 (15), pp.9073 - 9094. <Springer>. <10.1007/s11042-015-2863-3>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01436969
Contributeur : Jenny Benois-Pineau <>
Soumis le : lundi 16 janvier 2017 - 19:06:06
Dernière modification le : samedi 18 février 2017 - 01:10:23

Identifiants

Citation

Gabriel Sargent, Karina R. Perez-Daniel, Andrei Stoian, Jenny Benois-Pineau, Sofian Maabout, et al.. A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling. Multimedia Tools and Applications, Springer Verlag, 2015, Multimedia Tools and Applications, 75 (15), pp.9073 - 9094. <Springer>. <10.1007/s11042-015-2863-3>. <hal-01436969>

Partager

Métriques

Consultations de la notice

389