Identifying reading strategies employed by learners within their oral french self-explanations

Abstract : Natural Language Processing has massively evolved during the last years and many up-to-date applications integrate different speech tools in order to create an enhanced user experiences. For obtaining a seamless integration of existing speech recognition systems, there is a trending interest for developing and improving existing speech-to-text algorithms. The aim of this paper is to improve user interaction with the ReaderBench platform, by developing and integrating a speech recognition module designed so that young pupils can dictate their self-explanations to a given text. Afterwards, the ReaderBench framework is used to automatically evaluate the employed reading strategies based on the resulted speech transcriptions. A dataset containing 160 self-explanations from students ranging from 9 to 11 years old was analysed using both original transcripts, and the ones automatically generated by our custom speech recognition system. Multiple methods designed to perform speech recognition are also compared, while a new dedicated model was trained in order to improve the quality of the existing French model for speech recognition from CMUSphinx speech recognition system. Our revised model includes a pronunciation dictionary obtained after training a Long Short-Term Memory (LSTM) Grapheme-to-Phoneme neural network. The accuracy of our system is benchmarked in relation to the automated process of identifying reading strategies implemented in our ReaderBench framework, which is applied on both manual transcriptions and automated speech-to-text inputs. The obtained results argue for the adequacy of our method as the slight decrease in terms of identification accuracy is justifiable in contrast to the effort of manually transcribing each self-explanation.
Type de document :
Communication dans un congrès
I. Roceanu. Proc. 5th Int. Workshop on “Semantic and Collaborative Technologies for the Web“, joint to the 14th Int. Sci. Conf. on eLearning and Software for Education (eLSE 2018), 2018, Bucarest, Romania. “Carol I” National Defence University Publishing House, Proc. 5th Int. Workshop on “Semantic and Collaborative Technologies for the Web“, joint to the 14th Int. Sci. Conf. on eLearning and Software for Education (eLSE 2018), 2, pp.362-368, 2018, 〈http://www.elseconference.eu〉
Liste complète des métadonnées

Littérature citée [13 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01793007
Contributeur : Philippe Dessus <>
Soumis le : mercredi 16 mai 2018 - 10:06:35
Dernière modification le : mercredi 31 octobre 2018 - 01:16:07
Document(s) archivé(s) le : lundi 24 septembre 2018 - 18:43:49

Fichier

else18-hal.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01793007, version 1

Collections

TICE | UGA | LARAC

Citation

Marilena Panaite, Mihai Dascalu, Philippe Dessus, Maryse Bianco, Stefan Trausan-Matu. Identifying reading strategies employed by learners within their oral french self-explanations. I. Roceanu. Proc. 5th Int. Workshop on “Semantic and Collaborative Technologies for the Web“, joint to the 14th Int. Sci. Conf. on eLearning and Software for Education (eLSE 2018), 2018, Bucarest, Romania. “Carol I” National Defence University Publishing House, Proc. 5th Int. Workshop on “Semantic and Collaborative Technologies for the Web“, joint to the 14th Int. Sci. Conf. on eLearning and Software for Education (eLSE 2018), 2, pp.362-368, 2018, 〈http://www.elseconference.eu〉. 〈hal-01793007〉

Partager

Métriques

Consultations de la notice

31

Téléchargements de fichiers

19