Static and dynamic video summaries

Yingbo Li (1) , Bernard Merialdo (1) , Mickael Rouvier (2) , Georges Linares (2)

1 Eurecom [Sophia Antipolis]
2 LIA - Laboratoire Informatique d'Avignon

Currently there are a lot of algorithms for video summarization; however most of them only represent visual information. In this paper, we propose two approaches for the construction of the summary using both video and text. One approach focuses on static summaries, where the summary is a set of selected keyframes and keywords, to be displayed in a fixed area. The second approach addresses dynamic summaries where video segments are selected based on both their visual and textual content to compose a new video sequence of predefined duration. Our approaches rely on an existing summarization algorithm, Video Maximal Marginal Relevance (Video-MMR), and its extension Text Video Maximal Marginal Relevance (TV-MMR) proposed by us. We describe the details of those approaches and present experimental results.

Domaines: Informatique [cs]

Yingbo Li, Bernard Merialdo, Mickael Rouvier, Georges Linares. Static and dynamic video summaries. MM '11 ACM Multimedia Conference , Nov 2011, Scottsdale, United States. ⟨10.1145/2072298.2072068⟩. ⟨hal-01321200⟩