Principles of Evaluation in Natural Language Processing

Abstract : In this special issue of TAL, we look at the fundamental principles underlying evaluation in natural language processing. We adopt a global point of view that goes beyond the horizon of a single evaluation campaign or a particular protocol. After a brief review of history and terminology, we will address the topic of a gold standard for natural language processing, of annotation quality, of the amount of data, of the difference between technology evaluation and usage evaluation, of dialog systems, and of standards, before concluding with a short discussion of the articles in this special issue and some prospective remarks
Document type :
Journal articles
Traitement Automatique des Langues, ATALA, 2007, 48 (1), pp.7-31


https://hal.archives-ouvertes.fr/hal-00502700
Contributor : Stéphane Chaudiron <>
Submitted on : Monday, July 19, 2010 - 8:33:55 AM
Last modification on : Tuesday, April 21, 2015 - 6:10:06 PM

File

Intro_TAL_48_1.pdf
fileSource_public_publisherAgreement

Identifiers

  • HAL Id : hal-00502700, version 1

Collections

Citation

Patrick Paroubek, Stéphane Chaudiron, Lynette Hirschman. Principles of Evaluation in Natural Language Processing. Traitement Automatique des Langues, ATALA, 2007, 48 (1), pp.7-31. <hal-00502700>

Export

Share

Metrics

Consultation de
la notice

193

Téléchargement du document

452