On the Use of Dependencies in Relation Classification of Text with Deep Learning

Abstract : Deep Learning is more and more used in NLP tasks, such as in relation classification of texts. This paper assesses the impact of syntactic dependencies in this task at two levels. The first level concerns the generic Word Embedding (WE) as input of the classification model, the second level concerns the corpus whose relations have to be classified. In this paper, two classification models are studied, the first one is based on a CNN using a generic WE and does not take into account the dependencies of the corpus to be treated, and the second one is based on a compositional WE combining a generic WE with syntactical annotations of this corpus to classify. The impact of dependencies in relation classification is estimated using two different WE. The first one is essentially lexical and trained on the Wikipedia corpus in English, while the second one is also syntactical, trained on the same previously annotated corpus with syntactical dependencies. The two classification models are evaluated on the SemEval 2010 reference corpus using these two generic WE. The experiments show the importance of taking dependencies into account at different levels in the relation classification.
Complete list of metadatas

Cited literature [13 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02103919
Contributor : Adrian Chifu <>
Submitted on : Friday, April 19, 2019 - 1:57:11 AM
Last modification on : Wednesday, May 8, 2019 - 1:36:03 AM

File

On_the_Use_of_Dependencies_in_...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02103919, version 1

Collections

Citation

Bernard Espinasse, Sébastien Fournier, Adrian Chifu, Gaël Guibon, René Azcurra, et al.. On the Use of Dependencies in Relation Classification of Text with Deep Learning. 20th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing2019), Apr 2019, La Rochelle, France. ⟨hal-02103919⟩

Share

Metrics

Record views

40

Files downloads

33