A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis

Charly Awad 1 Nicolas Courty 1 Kyle Duarte 1 Thibaut Le Naour 2 Sylvie Gibet 1, 3
2 SEASIDE - SEarch, Analyze, Synthesize and Interact with Data Ecosystems
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, UBS - Université de Bretagne Sud
3 BUNRAKU - Perception, decision and action of real and virtual humans in virtual environments and impact on real environments
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : Over the past decade, many elds of discovery have begun to use motion capture data, leading to an exponential growth in the size of motion databases. Querying, indexing and retrieving motion capture data has thus become a crucial problem for the accessibility and usability of such databases. Our aim is to make this approach feasible for virtual agents signing in French Sign Language, taking into account the semantic information implicitly contained in sign language data.We propose a new methodology for accessing our database, by simultaneously using both a semantic and a captured-motion database, with dierent ways of index- ing the two database parts. This approach is used to eectively retrieve stored motions for the purposes of producing real-time sign language an- imations. The complete process and its in-use eciency are described, from querying motion in the semantic database to computing transitory segments between signs, and producing animations of a realistic virtual character.
Type de document :
Communication dans un congrès
9th Int. Conference on Intelligent Virtual Agent (IVA 2009), Sep 2009, Amsterdam, Netherlands. pp.432-438, 2009
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-00493426
Contributeur : Nicolas Courty <>
Soumis le : vendredi 18 juin 2010 - 16:58:45
Dernière modification le : mercredi 2 août 2017 - 10:09:51
Document(s) archivé(s) le : lundi 22 octobre 2012 - 12:00:25

Fichier

IVA2009.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00493426, version 1

Citation

Charly Awad, Nicolas Courty, Kyle Duarte, Thibaut Le Naour, Sylvie Gibet. A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis. 9th Int. Conference on Intelligent Virtual Agent (IVA 2009), Sep 2009, Amsterdam, Netherlands. pp.432-438, 2009. <hal-00493426>

Partager

Métriques

Consultations de
la notice

384

Téléchargements du document

229