Improving Cluster Selection and Event Modeling in Unsupervised Mining for Automatic Audiovisual Video Structuring

Anh-Phuong Ta 1 Mathieu Ben 2 Guillaume Gravier 1
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Can we discover audio-visually consistent events from videos in a totally unsupervised manner? And, how to mine videos with different genres? In this paper we present our new results in automatically discovering audio-visual events. A new measure is proposed to select audio-visually consistent elements from the two dendrograms respectively representing hierarchical clustering results for the audio and visual modalities. Each selected element corresponds to a candidate event. In order to construct a model for each event, each candidate event is represented as a group of clusters, and a voting mechanism is applied to select training examples for discriminative classifiers. Finally, the trained model is tested on the entire video to select video segments that belong to the event discovered. Experimental results on different and challenging genres of videos, show the effectiveness of our approach.
Document type :
Conference papers
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00671157
Contributor : Guillaume Gravier <>
Submitted on : Thursday, February 16, 2012 - 5:26:58 PM
Last modification on : Friday, November 16, 2018 - 1:22:56 AM
Long-term archiving on : Friday, November 23, 2012 - 4:21:10 PM

File

mmm2012_TA.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00671157, version 1

Citation

Anh-Phuong Ta, Mathieu Ben, Guillaume Gravier. Improving Cluster Selection and Event Modeling in Unsupervised Mining for Automatic Audiovisual Video Structuring. MMM - 18th International Conference on MultiMedia Modeling, 2012, Austria. ⟨hal-00671157⟩

Share

Metrics

Record views

1043

Files downloads

207