Hand and Lip desynchronization analysis in French Cued Speech: Automatic temporal segmentation of hand flow

Abstract : In the context of Cued Speech gesture phonetic translation, the automatic recognition of lip and hand movements is a key factor. The hand and the lip parameters are not synchronized, thus the fusion of the two channels (hand and lips) needs the knowledge of the desynchronized delay. This contribution focuses on the presentation of an automatic algorithm for temporal segmentation of the hand cue information based on Gaussian modeling of the hand position and minimum of velocity. The segmentation delivers the beginning of the hand transition and the instant of attained position. The hand segmentation is used to calculate the delay between hand and lip targets, in relation with the corresponding acoustic realization in the case of French CV syllables extracted from a corpus of phrases uttered and coded by a Cued Speech speaker. This study confirms in a more complex context the importance of the instant of attained hand position as pointed out by Attina and colleagues, in terms of control and for the fusion process.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00261527
Contributor : Noureddine Aboutabit <>
Submitted on : Friday, March 7, 2008 - 12:47:01 PM
Last modification on : Tuesday, July 9, 2019 - 1:26:58 AM
Long-term archiving on : Friday, May 21, 2010 - 12:02:05 AM

File

aboutabit.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Noureddine Aboutabit, Denis Beautemps, Laurent Besacier. Hand and Lip desynchronization analysis in French Cued Speech: Automatic temporal segmentation of hand flow. IEEE ICASSP, May 2006, Toulouse, France. pp.I-633:I-636, ⟨10.1109/ICASSP.2006.1660100⟩. ⟨hal-00261527⟩

Share

Metrics

Record views

501

Files downloads

183