Proposal for an Extension of Traditional Named Entitites: from Guidelines to Evaluation, an Overview

Cyril Grouin (1) , Sophie Rosset (1) , Pierre Zweigenbaum (1) , Karen Fort (2) , Olivier Galibert (3) , Ludovic Quintard (3)

1 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
2 LIPN - Laboratoire d'Informatique de Paris-Nord
3 LCM - Laboratoire commun de métrologie LNE-CNAM

Within the framework of the construction of a fact database, we defined guidelines to extract named entities, using a taxonomy based on an extension of the usual named entities defini- tion. We thus defined new types of entities with broader coverage including substantive- based expressions. These extended named en- tities are hierarchical (with types and compo- nents) and compositional (with recursive type inclusion and metonymy annotation). Human annotators used these guidelines to annotate a 1.3M word broadcast news corpus in French. This article presents the definition and novelty of extended named entity annotation guide- lines, the human annotation of a global corpus and of a mini reference corpus, and the evalu- ation of annotations through the computation of inter-annotator agreement. Finally, we dis- cuss our approach and the computed results, and outline further work.

Mots clés: named entities; annotation; evaluation

Domaines: Traitement du texte et du document

Cyril Grouin, Sophie Rosset, Pierre Zweigenbaum, Karen Fort, Olivier Galibert, et al.. Proposal for an Extension of Traditional Named Entitites: from Guidelines to Evaluation, an Overview. 5th Linguistics Annotation Workshop (The LAW V), Jun 2011, Portland, United States. pp.92--100. ⟨hal-00604369⟩