HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling

Abstract : Video summarization has been a core problem to manage the growing amount of content in multimedia databases. An efficient video summary should display an overview of the video content and most existing approaches fulfill this goal. However, such an overview does not allow the user to reach all details of interest selectively and progressively. This paper proposes a novel scalable summary generation approach based on the On-Line Analytical Processing data cube. Such a structure integrates tools like the drill down operation allowing to browse efficiently multiple descriptions of a dataset according to increased levels of detail. We adapt this model to video summary generation by expressing a video within a cross-media feature space and by performing clusterings according to particular subspaces. Consensus clustering is used to guide the subspace selection strategy at small dimensions, as the novelty brought by the least consensual subspaces is interesting for the refinements of a summary. Our approach is designed for weakly-structured contents such as cultural documentaries. We perform its evaluation on a corpus of cultural archives provided by the French Audiovisual National Institute (INA) using information retrieval metrics handling single and multiple reference annotations. The performances obtained overall improved results compared to two baseline systems performing random and arbitrary segmentations, showing a better balance between Precision and Recall.
Complete list of metadata

Contributor : Jenny Benois-Pineau Connect in order to contact the contributor
Submitted on : Monday, January 16, 2017 - 7:06:06 PM
Last modification on : Tuesday, February 22, 2022 - 3:08:10 AM



Gabriel Sargent, Karina R. Perez-Daniel, Andrei Stoian, Jenny Benois-Pineau, Sofian Maabout, et al.. A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling. Multimedia Tools and Applications, Springer Verlag, 2015, Multimedia Tools and Applications, 75 (15), pp.9073 - 9094. ⟨10.1007/s11042-015-2863-3⟩. ⟨hal-01436969⟩



Record views