Skip to Main content Skip to Navigation
New interface
Conference papers

Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task

Abstract : In this paper, we present a study on a French Spoken Language Understanding (SLU) task: the MEDIA task. Many works and studies have been proposed for many tasks, but most of them are focused on English language and tasks. The exploration of a richer language like French within the framework of a SLU task implies to recent approaches to handle this difficulty. Since the MEDIA task seems to be one of the most difficult, according to several previous studies, we propose to explore Neural Networks approaches focusing of three aspects: firstly, the Neu-ral Network inputs and more specifically the word embeddings; secondly, we compared French version of BERT against the best setup through different ways; Finally, the comparison against State-of-the-Art approaches. Results show that the word embeddings trained on a small corpus need to be updated during SLU model training. Furthermore, the French BERT fine-tuned approaches outperform the classical Neural Network Architectures and achieves state of the art results. However, the contextual embeddings extracted from one of the French BERT approaches achieve comparable results in comparison to word embedding, when integrated into the proposed neural architecture.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03007482
Contributor : Sahar Ghannay Connect in order to contact the contributor
Submitted on : Monday, November 16, 2020 - 1:30:12 PM
Last modification on : Sunday, June 26, 2022 - 2:56:59 AM
Long-term archiving on: : Wednesday, February 17, 2021 - 7:06:20 PM

File

Coling2020(3).pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03007482, version 1

Citation

Sahar Ghannay, Christophe Servan, Sophie Rosset. Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task. In Proceedings of The 28th International Conference on Computational Linguistics (COLING’2020), 2020, Dec 2020, Barcelona (online), Spain. ⟨hal-03007482⟩

Share

Metrics

Record views

108

Files downloads

118