Coarticulation Analysis for Sign Language Synthesis

Lucie Naert 1 Caroline Larboulette 1 Sylvie Gibet 1
1 EXPRESSION - Expressiveness in Human Centered Data/Media
UBS - Université de Bretagne Sud, IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : A sign language utterance can be seen as a continuous stream of motion, involving the signs themselves and inter-sign movements or transitions. Like in speech, coarticulation constitutes an important part of the language. Indeed, the signs are contextualized: their form and, most of all, the transitions will greatly depend on the surrounding signs. For that reason, the manual segmentation of sign language utterances is a difficult and imprecise task. Besides, annotators often assume that both hands are synchronous, which is not always true in practice. In this paper, we first propose a technique to automatically refine the segmentation by adjusting the manual tags isolating signs from transitions. We then study motion transitions between consecutive signs and, in particular, the duration of those transitions. We propose several computation techniques for the transition duration based on the analysis we have conducted. Finally, we use our findings in our motion synthesis platform to create new utterances in French Sign Language.
Type de document :
Communication dans un congrès
International Conference on Universal Access in Human-Computer Interaction, Jul 2017, Vancouver, Canada
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01649815
Contributeur : Caroline Larboulette <>
Soumis le : lundi 27 novembre 2017 - 18:19:50
Dernière modification le : mercredi 16 mai 2018 - 11:24:07

Fichier

uahci2017_naert_cr_withpagenum...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01649815, version 1

Citation

Lucie Naert, Caroline Larboulette, Sylvie Gibet. Coarticulation Analysis for Sign Language Synthesis. International Conference on Universal Access in Human-Computer Interaction, Jul 2017, Vancouver, Canada. 〈hal-01649815〉

Partager

Métriques

Consultations de la notice

158

Téléchargements de fichiers

43