Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluation

Abstract : Recent works in spoken language translation (SLT) have attempted to build end-to-end speech-to-text translation without using source language transcription during learning or decoding. However, while large quantities of parallel texts (such as Europarl, OpenSubtitles) are available for training machine translation systems, there are no large (>100h) and open source parallel corpora that include speech in a source language aligned to text in a target language. This paper tries to fill this gap by augmenting an existing (monolingual) corpus: LibriSpeech. This corpus, used for automatic speech recognition, is derived from read audiobooks from the LibriVox project, and has been carefully segmented and aligned. After gathering French e-books corresponding to the English audio-books from LibriSpeech, we align speech segments at the sentence level with their respective translations and obtain 236h of usable parallel data. This paper presents the details of the processing as well as a manual evaluation conducted on a small subset of the corpus. This evaluation shows that the automatic alignments scores are reasonably correlated with the human judgments of the bilingual alignment quality. We believe that this corpus (which is made available online) is useful for replicable experiments in direct speech translation or more general spoken language translation experiments.
Type de document :
Communication dans un congrès
LREC (Language Resources and Evaluation Conference), Feb 2018, Miyazaki, Japan
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01709568
Contributeur : Laurent Besacier <>
Soumis le : jeudi 15 février 2018 - 10:07:47
Dernière modification le : jeudi 11 octobre 2018 - 08:48:03
Document(s) archivé(s) le : lundi 7 mai 2018 - 19:44:29

Fichier

xample.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01709568, version 1

Collections

Citation

Ali Kocabiyikoglu, Laurent Besacier, Olivier Kraif. Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluation. LREC (Language Resources and Evaluation Conference), Feb 2018, Miyazaki, Japan. 〈hal-01709568〉

Partager

Métriques

Consultations de la notice

81

Téléchargements de fichiers

99