Results of the French Evalda-Media evaluation campaign for literal understanding

Abstract : The aim of the MEDIA-EVALDA project is to evaluate the understanding capabilities of dialog systems. This paper presents the MEDIA protocol for speech understanding evaluation and describes the results of the June 2005 literal evaluation campaign. Five systems, both symbolic or corpus-based participated to the evaluation which is based on a common semantic representation. Different scorings have been performed on the system results. The understanding error rate, for the Full scoring is, depending on the systems, from 29% to 41.3%. A diagnosis analysis of these results is proposed.
Type de document :
Communication dans un congrès
The fifth international conference on Language Resources and Evaluation (LREC 2006), May 2006, Genes, Italy
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01160167
Contributeur : Christophe Servan <>
Soumis le : jeudi 4 juin 2015 - 16:01:16
Dernière modification le : mardi 12 février 2019 - 01:30:26
Document(s) archivé(s) le : mardi 25 avril 2017 - 06:25:06

Fichier

0c960525bb1bde4482000000.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : hal-01160167, version 1

Citation

H Bonneau-Maynard, C Ayache, F Bechet, Alexandre Denis, A Kuhn, et al.. Results of the French Evalda-Media evaluation campaign for literal understanding. The fifth international conference on Language Resources and Evaluation (LREC 2006), May 2006, Genes, Italy. 〈hal-01160167〉

Partager

Métriques

Consultations de la notice

818

Téléchargements de fichiers

95