Multiple Tasks Integration

Timothée Bernard (1, 2)

1 LLF - UMR7110 - Laboratoire de Linguistique Formelle
2 UFR Linguistique UPCité - UFR Linguistique [Sociétés et Humanités] - Université Paris Cité

Departing from both sequential pipelines and monotask systems, we propose Multiple Tasks Integration (MTI), a multitask paradigm orthogonal to weight sharing. The essence of MTI is to process the input iteratively but concurrently at multiple levels of analysis, where each decision is based on all of the structures that are already inferred and free from usual ordering constraints. We illustrate MTI with a system that performs part-of-speech tagging, syntactic dependency parsing and semantic dependency parsing. We observe that both the use of reinforcement learning and the release from sequential constraints are beneficial to the quality of the syntactic and semantic parses. We also observe that our model adopts an easy-first strategy that consists, on average, of predicting shorter dependencies before longer ones, but that syntax is not always tackled before semantics.

Domaines: Traitement du texte et du document; Informatique et langage [cs.CL]; Linguistique

Timothée Bernard. Multiple Tasks Integration: Tagging, Syntactic and Semantic Parsing as a Single Task. EACL 2021 - 16th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2021, Kyiv, Ukraine. ⟨hal-03601585⟩