Adapting a FrameNet Semantic Parser for Spoken Language Understanding Using Adversarial Learning

Gabriel Marzinotto (1, 2) , Geraldine Damnati (2) , Frédéric Béchet (1)

1 TALEP - Traitement Automatique du Langage Ecrit et Parlé
2 Orange Labs [Lannion]

This paper presents a new semantic frame parsing model, based on Berkeley FrameNet, adapted to process spoken documents in order to perform information extraction from broadcast contents. Building upon previous work that had shown the effectiveness of adversarial learning for domain generalization in the context of semantic parsing of encyclopedic written documents, we propose to extend this approach to elocutionary style generalization. The underlying question throughout this study is whether adversarial learning can be used to combine data from different sources and train models on a higher level of abstraction in order to increase their robustness to lexical and stylistic variations as well as automatic speech recognition errors. The proposed strategy is evaluated on a French corpus of encyclopedic written documents and a smaller corpus of radio podcast transcriptions, both annotated with a FrameNet paradigm. We show that adversarial learning increases all models generalization capabilities both on manual and automatic speech transcription as well as on encyclopedic data.

Mots clés: understanding; semantic parsing; Index Terms: semantic parsing; spoken language; speech recognition; Adversarial learning; FrameNet; Adversarial learn- ing

Domaines: Informatique et langage [cs.CL]

Gabriel Marzinotto, Geraldine Damnati, Frédéric Béchet. Adapting a FrameNet Semantic Parser for Spoken Language Understanding Using Adversarial Learning. Interspeech 2019, Sep 2019, Graz, Austria. pp.799-803, ⟨10.21437/Interspeech.2019-2732⟩. ⟨hal-02298417⟩