Exploiting Multimodality in Video Hyperlinking to Improve Target Diversity

Abstract : Video hyperlinking is the process of creating links within a collection of videos to help navigation and information seeking. Starting from a given set of video segments, called anchors, a set of related segments, called targets, must be provided. In past years, a number of content-based approaches have been proposed with good results obtained by searching for target segments that are very similar to the anchor in terms of content and information. Unfortunately, relevance has been obtained to the expense of diversity. In this paper, we study multimodal approaches and their ability to provide a set of diverse yet relevant targets. We compare two recently introduced cross-modal approaches, namely, deep auto-encoders and bimodal LDA, and experimentally show that both provide significantly more diverse targets than a state-of-the-art baseline. Bimodal autoencoders offer the best trade-off between relevance and diversity, with bimodal LDA exhibiting slightly more diverse targets at a lower precision.
Type de document :
Communication dans un congrès
Amsaleg, Laurent; Guðmundsson, Gylfi Þór; Gurrin, Cathal; Satoh, Shin’ichi. MMM2017 - International Conference on Multimedia Modeling, Jan 2017, Reykyavik, Iceland. Springer, 10133, 2017, Lecture Notes in Computer Science. 〈10.1007/978-3-319-51814-5_16〉
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01498130
Contributeur : Guillaume Gravier <>
Soumis le : jeudi 22 mars 2018 - 23:01:20
Dernière modification le : mercredi 16 mai 2018 - 11:24:14

Fichier

diversity.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Rémi Bois, Vedran Vukotic, Anca-Roxana Simon, Ronan Sicre, Christian Raymond, et al.. Exploiting Multimodality in Video Hyperlinking to Improve Target Diversity. Amsaleg, Laurent; Guðmundsson, Gylfi Þór; Gurrin, Cathal; Satoh, Shin’ichi. MMM2017 - International Conference on Multimedia Modeling, Jan 2017, Reykyavik, Iceland. Springer, 10133, 2017, Lecture Notes in Computer Science. 〈10.1007/978-3-319-51814-5_16〉. 〈hal-01498130v2〉

Partager

Métriques

Consultations de la notice

241

Téléchargements de fichiers

28