CONTOUR-BASED 3D TONGUE MOTION VISUALIZATION USING ULTRASOUND IMAGE SEQUENCES

Kele Xu (1) , Yin Yang (2) , Clémence Leboullenger (1) , Pierre Roussel (1) , Bruce Denby (3)

1 SIGMA - Laboratoire Signaux, Modèles et Apprentissage Statistique
2 ECE Department - Department of Electrical and Computer Engineering [Albuquerque]
3 UPMC - Université Pierre et Marie Curie - Paris 6

This article describes a contour-based 3D tongue deformation visualization framework using B-mode ultrasound image sequences. A robust, automatic tracking algorithm characterizes tongue motion via a contour, which is then used to drive a generic 3D Finite Element Model (FEM). A novel contour-based 3D dynamic modeling method is presented. Modal reduction and modal warping techniques are applied to model the deformation of the tongue physically and efficiently. This work can be helpful in a variety of fields, such as speech production, silent speech recognition, articulation training, speech disorder study, etc.

Mots clés: Index Terms— Silent speech interface; ultrasound; tongue; motion visualization

Domaines: Intelligence artificielle [cs.AI]

Kele Xu, Yin Yang, Clémence Leboullenger, Pierre Roussel, Bruce Denby. CONTOUR-BASED 3D TONGUE MOTION VISUALIZATION USING ULTRASOUND IMAGE SEQUENCES. ICASSP 2016, Mar 2016, SHANGHAI, China. ⟨hal-01318233⟩