Annotating Football Matches: Influence of the Source Medium on Manual Annotation

Karen Fort (1) , Vincent Claveau (2)

1 LIPN - Laboratoire d'Informatique de Paris-Nord
2 TEXMEX - Multimedia content-based indexing

In this paper, we present an annotation campaign of football (soccer) matches, from a heterogeneous text corpus of both match minutes and video commentary transcripts, in French. The data, annotations and evaluation process are detailed, and the quality of the annotated corpus is discussed. In particular, we propose a new technique to better estimate the annotator agreement when few elements of a text are to be annotated. Based on that, we show how the source medium influenced the process and the quality.

Mots clés: Manual corpus annotation; Inter-annotator agreement; Football

Domaines: Traitement du texte et du document

Karen Fort, Vincent Claveau. Annotating Football Matches: Influence of the Source Medium on Manual Annotation. LREC - Eight International Conference on Language Resources and Evaluation, May 2012, Istanbul, Turkey. ⟨hal-00709170⟩