Tracking contours of orofacial articulators from real-time MRI of speech

Mathieu Labrunie (1) , Pierre Badin (1) , Dirk Voit (2) , Arun A Josep (2) , Laurent Lamalle (3) , Coriandre Emmanuel Vilain (4, 5) , Louis-Jean Boë (4) , Jens Frahm (2)

1 GIPSA-CRISSP - GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing
2 Biomedizinische NMR Forschungs GmbH [Göttingen]
3 IRMaGe - IRMaGe
4 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole
5 GIPSA-Services - GIPSA-Services

We introduce a method for predicting midsagittal contours of orofacial articulators from real-time MRI data. A corpus of about 26 minutes of speech has been recorded of a French speaker at a rate of 55 images / s using highly undersampled radial gradient-echo MRI with image reconstruction by nonlinear inversion. The contours of each articulator have been manually traced for a set of about 60 images selected – by hierarchical clustering – to optimally represent the diversity of the speaker articulations. The data serve to build articulator-specific Principal Component Analysis (PCA) models of contours and associated image intensities, as well as multilinear regression (MLR) models that predict contour parameters from image parameters. The contours obtained by MLR are then refined, using the local information about pixel intensity profiles along the contours' normals, by means of modified Active Shape Models (ASM) trained on the same data. The method reaches RMS of predicted points to reference contour distances between 0.54 and 0.93 mm, depending on articulators. The processing of the corpus demonstrated the efficiency of the procedure, despite the possibility of further improvements. This work opens new perspectives for studying articulatory motion in speech.

Mots clés: Real-time MRI; orofacial articulators; speech articulation; automatic contour tracking; multiple linear regression; Active Shape Models

Domaines: Sciences de l'information et de la communication

Mathieu Labrunie, Pierre Badin, Dirk Voit, Arun A Josep, Laurent Lamalle, et al.. Tracking contours of orofacial articulators from real-time MRI of speech. Interspeech 2016 - 17th Annual Conference of the International Speech Communication Association, Sep 2016, San Francisco, United States. pp.470-474, ⟨10.21437/Interspeech.2016-78⟩. ⟨hal-01368251⟩