Quasi-automatic extraction method of tongue movement from a large existing speech cineradiographic database

Julie Fontecave Jallon (1) , Frédéric Berthommier (1)

1 ICP - Institut de la communication parlée

Automatic analysis of tongue movement in large existing cineradiographic databases can provide valuable information to understood speech production. We describe here a method for semi-automatic extraction of articulatory information from video observation in order to derive quasi-automatically a geometrical parameterization of the vocal tract movements. The algorithm starts with a limited manual processing step consisting in marking 10 points (12 degrees of freedom) on 100 chosen key images. The treatment on the whole sequence is then automatic thanks to a retro-marking method. At first, the whole database is indexed via a similarity measure performed with the key images. Then, we associate on the original images the geometrical information recovered on the key images via this indexing. Different complementary error reduction methods are also proposed. Averaging geometrical configurations of a neighborhood, temporal filtering and spline interpolation allow to reduce the reconstruction error to about 10 pixels for a tongue contour of average length of 260 pixels.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Julie Fontecave Jallon, Frédéric Berthommier. Quasi-automatic extraction method of tongue movement from a large existing speech cineradiographic database. Interspeech 2005, Sep 2005, Portugal. pp.1081-1084. ⟨hal-00373270⟩