Assessing the impact of OCR noise on multilingual event detection over digitised documents - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal on Digital Libraries Année : 2022

Assessing the impact of OCR noise on multilingual event detection over digitised documents

Résumé

Event detection (ED) is a crucial task for natural language processing (NLP) and it involves the identification of instances of specified types of events in text and their classification into event types. The detection of events from digitised documents could enable historians to gather and combine a large amount of information into an integrated whole, a panoramic interpretation of the past. However, the level of degradation of digitised documents and the quality of the optical character recognition (OCR) tools might hinder the performance of an event detection system. While several studies have been performed in detecting events from historical documents, the transcribed documents needed to be hand-validated which implied a great effort of human expertise and manual labor-intensive work. Thus, in this study, we explore the robustness of two different event detection language-independent models to OCR noise, over two datasets that cover different event types and multiple languages. We aim at analysing their ability to mitigate problems caused by the low quality of the digitised documents and we simulate the existence of transcribed data, synthesised from clean annotated text, by injecting synthetic noise. For creating the noisy synthetic data, we chose to utilise four main types of noise that commonly occur after the digitisation process: Character Degradation, Bleed Through, Blur, and Phantom Character. Finally, we conclude that the imbalance of the datasets, the richness of the different annotation styles, and the language characteristics are the most important factors that can influence event detection in digitised documents.
Fichier principal
Vignette du fichier
IJDL2022-Assessing the Impact of OCR Noise on Multilingual Event Detection over Digitised Documents.pdf (1.37 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03635985 , version 1 (08-04-2022)

Identifiants

Citer

Emanuela Boros, Nhu Khoa Nguyen, Gaël Lejeune, Antoine Doucet. Assessing the impact of OCR noise on multilingual event detection over digitised documents. International Journal on Digital Libraries, 2022, ⟨10.1007/s00799-022-00325-2⟩. ⟨hal-03635985⟩
62 Consultations
143 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More