An evaluation model for systems and resources employed in the correction of errors in textual documents

Abstract : The wide adoption of Web 2.0 services has resulted in an increase in the amount of information produced. The quantity of errors contained in such information has grown even faster. Indeed, in traditional information production process documents were produced by professionals while in the Web context the content is generated by the users themselves. It is therefore necessary to take into account the errors particularly when such systems need to manage information of variable quality. Our state of the art leads us to identify difficulties in the comparative evaluation of error correction systems. Our proposal consists in an evaluation model for error correction systems and low-level string similarity (and distance) metrics they rely on. This model is implemented in an extensible platform providing a framework to evaluate those systems.