Improvements for a German Vowel Trainer CAPT Tool

Patrick Carroll 1 Jürgen Trouvain 1 Frank Zimmerer 1 Yves Laprie 2 Odile Mella 2 Dominique Fohr 2
2 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : The research proposes continued improvements to a prototype CAPT tool (Carroll et al., 2015) designed to improve German vowel pronunciation for L2 German learners. The CAPT tool functions as a listening and response exercise where L2 learners hear native German productions of selected vowels, and then record their own vowel productions. The tool incorporates a visual feedback tool which shows users a graphical representation of acoustic and durational information of their vowels alongside target values and examples from native speakers. The aim of the visual feedback is for users to identify how their vowel productions di ffer from standard pronunciation, and then to adjust their productions until they approximate the correct pronunciation. The previous prototype was a proof of concept, but off ered limited functionality, thus in this poster presentation we consider the steps needed to implement a full featured system. Included in the presentation is a discussion of the following open questions: How to select a suitable corpus of training sentences? How to design the visual interface for maximum intelligibility by non phoneticians? And what sort of other feedback, training, or instruction is necessary for the system to achieve it's aim of improving L2 German vowel production? The problem of selecting suitable training sentences will need to be evaluated from both a technical and pedagogic perspective. The technological challenge stems from the fact that vowels must be automatically recognized and extracted (F1/F2/duration) from the spoken sentences. Therefore carrier words should have the vowel in as neutral context as possible to improve accuracy from the system's algorithms. The pedagogic challenge is to find examples sentences which impress upon L2 learners situations where a mispronounced vowel drastically changes the meaning of a word or phrase (making it linguistically important). When designing the visual feedback interface, we ask ourselves what kind of graphical representations of formant values and vowel duration are intuitive to the users. The prototype version plotted vowels in a 2-D space similar to the IPA vowel chart, with accompanying bars representing duration. In this presentation we discuss other alternatives such as using geometric shapes and color gradients to depict the vowel information. The final open question seeks to address whether users can understand and bene fit from a CAPT system with just the core functionality described, or if these users require further training and instruction. For example, should a meta-linguistic explanation be given of why vowel length and quality is important in German? And should users rst train to perceive differences between similar German vowels, before they try to produce them on their own. The poster presentation attempts to address these open questions, and show our current thoughts on best practices for continued development on the CAPT system.
Type de document :
Poster
Individualized Feedback for Computer-Assisted Spoken Language Learning, Nov 2015, Tholey, Germany. 2015
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01243043
Contributeur : Dominique Fohr <>
Soumis le : lundi 14 décembre 2015 - 14:48:53
Dernière modification le : mardi 18 décembre 2018 - 16:38:02

Identifiants

  • HAL Id : hal-01243043, version 1

Collections

Citation

Patrick Carroll, Jürgen Trouvain, Frank Zimmerer, Yves Laprie, Odile Mella, et al.. Improvements for a German Vowel Trainer CAPT Tool. Individualized Feedback for Computer-Assisted Spoken Language Learning, Nov 2015, Tholey, Germany. 2015. 〈hal-01243043〉

Partager

Métriques

Consultations de la notice

712