An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign

Damien Nouvel (1) , Jean-Yves Antoine (1) , Nathalie Friburger (1) , Denis Maurel (1)

1 BDTLN - Bases de données et traitement des langues naturelles

In this paper, we present a detailed and critical analysis of the behaviour of the CasEN named entity recognition system during the French Ester2 evaluation campaign. In this project, CasEN has been confronted with the task of detecting and categorizing named entities in manual and automatic transcriptions of radio broadcastings. At first, we give a general presentation of the Ester2 campaign. Then, we describe our system, based on transducers. Next, we depict how systems were evaluated during this campaign and we report the main official results. Afterwards, we investigate in details the influence of some annotation biases which have significantly affected the estimation of the performances of systems. At last, we conduct an in-depth analysis of the effective errors of the CasEN system, providing us with some useful indications about phenomena that gave rise to errors (e.g. metonymy, encapsulation, detection of right boundaries) and are as many challenges for named entity recognition systems.

Mots clés: Named Entity detection; evaluation; text mining; sequences mining

Domaines: Informatique et langage [cs.CL]

Damien Nouvel, Jean-Yves Antoine, Nathalie Friburger, Denis Maurel. An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign. 2010. ⟨hal-00502370⟩