End-to-end named entity and semantic concept extraction from speech

Abstract : Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process that consists in processing first an automatic speech recognition (ASR) on the audio and then processing a NER on the ASR outputs. Such approach has some disadvantages (error propagation, metric to tune ASR systems sub-optimal in regards to the final task, reduced space search at the ASR output level,...) and it is known that more integrated approaches outperform sequential ones, when they can be applied. In this paper, we explore an end-to-end approach that directly extracts named entities from speech, though a unique neural architecture. On a such way, a joint optimization is possible for both ASR and NER. Experiments are carried on French data easily accessible, composed of data distributed in several evaluation campaigns. The results are promising since this end-to-end approach provides similar results (F-measure=0.66 on test data) than a classical pipeline approach to detect named entity categories (F-measure=0.64). Last, we also explore this approach applied to semantic concept extraction , through a slot filling task known as a spoken language understanding problem.
Type de document :
Communication dans un congrès
IEEE Spoken Language Technology Workshop, Dec 2018, Athens, Greece
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01987740
Contributeur : Yannick Estève <>
Soumis le : lundi 21 janvier 2019 - 11:58:45
Dernière modification le : mercredi 13 février 2019 - 16:02:44

Fichier

slt_e2e_enslu.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01987740, version 1

Collections

Citation

Sahar Ghannay, Antoine Caubrière, Yannick Estève, Nathalie Camelin, Edwin Simonnet, et al.. End-to-end named entity and semantic concept extraction from speech. IEEE Spoken Language Technology Workshop, Dec 2018, Athens, Greece. 〈hal-01987740〉

Partager

Métriques

Consultations de la notice

25

Téléchargements de fichiers

6