Extrinsic Evaluation of French Dependency Parsers on a Specialized Corpus: Comparison of Distributional Thesauri

Ludovic Tanguy (1) , Pauline Brunet (2) , Olivier Ferret (2)

1 CLLE - Cognition, langues, langage, ergonomie
2 LIST (CEA) - Laboratoire d'Intégration des Systèmes et des Technologies

We present a study in which we compare 11 different French dependency parsers on a specialized corpus (consisting of research articles on NLP from the proceedings of the TALN conference). Due to the lack of a suitable gold standard, we use each of the parsers' output to generate distributional thesauri using a frequency-based method. We compare these 11 thesauri to assess the impact of choosing a parser over another. We show that, without any reference data, we can still identify relevant subsets among the different parsers. We also show that the similarity we identify between parsers is confirmed on a restricted distributional benchmark.

Mots clés: French dependency parsing; distributional semantics; specialized corpus

Domaines: Informatique et langage [cs.CL]; Linguistique

Ludovic Tanguy, Pauline Brunet, Olivier Ferret. Extrinsic Evaluation of French Dependency Parsers on a Specialized Corpus: Comparison of Distributional Thesauri. 12th International Conference on Language Resources and Evaluation (LREC 2020), May 2020, Marseille, France. pp.5822-5830. ⟨hal-02611042⟩