Visual articulatory feedback for phonetic correction in second language learning

Pierre Badin (1) , Atef Ben Youssef (1) , Gérard Bailly (1) , Frédéric Elisei (2) , Thomas Hueber (1)

1 GIPSA-MAGIC - GIPSA - Machines parlantes, Gestes oro-faciaux, Interaction Face-à-face, Communication augmentée
2 GIPSA-Services - GIPSA-Services

Orofacial clones can display speech articulation in an augmented mode, i.e. display all major speech articulators, including those usually hidden such as the tongue or the velum. Besides, a number of studies tend to show that the visual articulatory feedback provided by ElectroPalatoGraphy or ultrasound echography is useful for speech therapy. This paper describes the latest developments in acoustic-to-articulatory inversion, based on statistical models, to drive orofacial clones from speech sound. It suggests that this technology could provide a more elaborate feedback than previously available, and that it would be useful in the domain of Computer Aided Pronunciation Training.

Mots clés: Visual articulatory feedback; CAPT; ElectroMagnetic Articulography; speaker normalisation; acoustic-to-articulatory inversion; orofacial clone; language learning; speech therapy; Hidden Markov Models

Domaines: Sciences de l'information et de la communication

Pierre Badin, Atef Ben Youssef, Gérard Bailly, Frédéric Elisei, Thomas Hueber. Visual articulatory feedback for phonetic correction in second language learning. Interspeech 2010 - 11th Annual Conference of the International Speech Communication Association, Sep 2010, Makuhari, Japan. pp.n.c. ⟨hal-00508272⟩