A Proposed Methodology for Subjective Evaluation of Video and Text Summarization

Abstract : To evaluate a system that automatically summarizes video files (image and audio), it should be taken into account how the system works and which are the part of the process that should be evaluated, as two main topics to be evaluated can be differentiated: the video summary and the text summary. So, in the present article it is presented a complete way in order to evaluate this type of systems efficiently. With this objective, the authors have performed two types of evaluation: objective and subjective (the main focus of this paper). The objective evaluation is mainly done automatically, using established and proven metrics or frameworks, but it may need in some way the participation of humans, while the subjective evaluation is based directly on the opinion of people, who evaluate the system by answering a set of questions, which are then processed in order to obtain the targeted conclusions. The obtained general results from both evaluation systems will provide valuable information about the completeness and coherence, as well as the correctness of the generated summarizations from different points of view, as the lexical, semantical, etc. perspective. Apart from providing information about the state of the art, it will be presented an experimental proposal too, including the parameters of the experiment and the evaluation methods to be applied.
Type de document :
Communication dans un congrès
MISSI 2018 - 11th edition of the International Conference on Multimedia and Network Information Systems, Sep 2018, Wrocław, Poland. Springer, 833, pp.396-404, 2018, Advances in Intelligent Systems and Computing. 〈10.1007/978-3-319-98678-4_40〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01873685
Contributeur : Kamel Smaïli <>
Soumis le : mercredi 19 septembre 2018 - 14:41:22
Dernière modification le : jeudi 7 février 2019 - 15:54:38
Document(s) archivé(s) le : jeudi 20 décembre 2018 - 12:45:47

Fichier

Garcia-Zapirain2019_Chapter_AP...
Accord explicite pour ce dépôt

Identifiants

Collections

Citation

Begona Garcia-Zapirain, Cristian Castillo, Aritz Badiola, Sofia Zahia, Amaia Mendez, et al.. A Proposed Methodology for Subjective Evaluation of Video and Text Summarization. MISSI 2018 - 11th edition of the International Conference on Multimedia and Network Information Systems, Sep 2018, Wrocław, Poland. Springer, 833, pp.396-404, 2018, Advances in Intelligent Systems and Computing. 〈10.1007/978-3-319-98678-4_40〉. 〈hal-01873685〉

Partager

Métriques

Consultations de la notice

128

Téléchargements de fichiers

87