TermITH-Eval: a French Standard-Based Resource for Keyphrase Extraction Evaluation

Abstract : Keyphrase extraction is the task of finding phrases that represent the important content of a document. The main aim of keyphrase extraction is to propose textual units that represent the most important topics developed in a document. The output keyphrases of automatic keyphrase extraction methods for test documents are typically evaluated by comparing them to manually assigned reference keyphrases. Each output keyphrase is considered correct if it matches one of the reference keyphrases. However, the choice of the appropriate textual unit (keyphrase) for a topic is sometimes subjective and evaluating by exact matching underestimates the performance. This paper presents a dataset of evaluation scores assigned to automatically extracted keyphrases by human evaluators. Along with the reference keyphrases, the manual evaluations can be used to validate new evaluation measures. Indeed, an evaluation measure that is highly correlated to the manual evaluation is appropriate for the evaluation of automatic keyphrase extraction methods.
Type de document :
Communication dans un congrès
LREC - Language Resources and Evaluation Conference, May 2016, Potoroz, Slovenia
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01693805
Contributeur : Florian Boudin <>
Soumis le : jeudi 1 février 2018 - 14:41:41
Dernière modification le : jeudi 15 novembre 2018 - 20:27:26
Document(s) archivé(s) le : mercredi 2 mai 2018 - 13:07:08

Fichier

791_Paper.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : hal-01693805, version 1

Collections

Citation

Adrien Bougouin, Sabine Barreaux, Laurent Romary, Florian Boudin, Béatrice Daille. TermITH-Eval: a French Standard-Based Resource for Keyphrase Extraction Evaluation. LREC - Language Resources and Evaluation Conference, May 2016, Potoroz, Slovenia. 〈hal-01693805〉

Partager

Métriques

Consultations de la notice

195

Téléchargements de fichiers

39