Virtual Agent for Deaf Signing Gestures

Abstract : We describe in this paper a system for automatically synthesizing deaf signing animations from motion data captured on real deaf subjects. Moreover, we create a virtual agent endowed with expressive gestures. Our attention is focused on the expressiveness of gesture (what type of gesture: fluidity, tension, anger) and on its semantic representations. Our approach relies on a data-driven animation scheme. From motion data captured thanks to an optical system and data gloves, we try to extract relevant features of communicative gestures, and to re-synthesize them afterwards with style variation. Within this framework, a motion database containing the whole body, hands motion and facial expressions has been built. The analysis of signals makes possible the enrichment of this database by including segmentation and annotation descriptors. Analysis and synthesis algorithms are applied to the generation of a set of French Sign Language gestures. Key words Communication for deaf people, sign language gestures, virtual signer agent, gesture database.
Type de document :
Article dans une revue
AMSE, Journal of the Association for the Advancement of Modelling and Simulation Techniques in Enterprises (Special edition HANDICAP), 2006, 67, pp.127--136
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-00494241
Contributeur : Nicolas Courty <>
Soumis le : mardi 22 juin 2010 - 14:48:33
Dernière modification le : vendredi 16 juin 2017 - 16:30:48
Document(s) archivé(s) le : vendredi 24 septembre 2010 - 17:45:53

Fichier

Gibet_AMSE.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00494241, version 1

Citation

Sylvie Gibet, Alexis Héloir, Nicolas Courty, Jean-François Kamp, Philippe Gorce, et al.. Virtual Agent for Deaf Signing Gestures. AMSE, Journal of the Association for the Advancement of Modelling and Simulation Techniques in Enterprises (Special edition HANDICAP), 2006, 67, pp.127--136. <hal-00494241>

Partager

Métriques

Consultations de
la notice

525

Téléchargements du document

154