Skip to Main content Skip to Navigation
New interface

Collaborative Annotation for Reliable Natural Language Processing: Technical and Sociological Aspects

Abstract : This book presents a unique opportunity for constructing a consistent image of collaborative manual annotation for Natural Language Processing (NLP). NLP has witnessed two major evolutions in the past 25 years: firstly, the extraordinary success of machine learning, which is now, for better or for worse, overwhelmingly dominant in the field, and secondly, the multiplication of evaluation campaigns or shared tasks. Both involve manually annotated corpora, for the training and evaluation of the systems. These corpora have progressively become the hidden pillars of our domain, providing food for our hungry machine learning algorithms and reference for evaluation. Annotation is now the place where linguistics hides in NLP. However, manual annotation has largely been ignored for some time, and it has taken a while even for annotation guidelines to be recognized as essential. Although some efforts have been made lately to address some of the issues presented by manual annotation, there has still been little research done on the subject. This book aims to provide some useful insights into the subject. Manual corpus annotation is now at the heart of NLP, and is still largely unexplored. There is a need for manual annotation engineering (in the sense of a precisely formalized process), and this book aims to provide a first step towards a holistic methodology, with a global view on annotation.
Document type :
Complete list of metadata
Contributor : Karën Fort Connect in order to contact the contributor
Submitted on : Thursday, November 19, 2020 - 2:54:39 PM
Last modification on : Sunday, June 26, 2022 - 9:39:17 AM
Long-term archiving on: : Saturday, February 20, 2021 - 8:01:23 PM


Files produced by the author(s)


  • HAL Id : hal-01324322, version 1


Karën Fort. Collaborative Annotation for Reliable Natural Language Processing: Technical and Sociological Aspects. Patrick Paroubek. Wiley-ISTE, pp.196, 2016, 978-1-84821-904-5. ⟨hal-01324322⟩



Record views


Files downloads