 |
|
|
|
| HAL : hal-00327779, version 1 |
| Fiche détaillée |  Récupérer au format |
|
|
| Pattern Recognition 42, 5 (2009) 812-822 |
|
|
|
|
| A Belief-Based Sequential Fusion Approach for Fusing Manual and Non-Manual Signs |
|
|
| Oya Aran 1Thomas Burger 2 |
|
|
| (2009) |
|
|
|
| Most of the research on sign language recognition concentrates on recognizing only manual signs (hand gestures and shapes), discarding a very important component: the non-manual signs (facial expressions and head/shoulder motion). We address the recognition of signs with both manual and nonmanual components using a sequential belief-based fusion technique. The manual components, which carry information of primary importance, are utilized in the first stage. The second stage, which makes use of nonmanual components, is only employed if there is hesitation in the decision of the first stage. We employ belief formalism both to model the hesitation and to determine the sign clusters within which the discrimination takes place in the second stage. We have implemented this technique in a sign tutor application. Our results on the eNTERFACE'06 ASL database show an improvment over the baseline system which uses parallel or feature fusion of manual and non-manual features via HMM recognizers and achieves an accuracy of 81.6%. |
|
|
|
|
|
|
|
|
|
|
|
| 1 : | Dep. of Computer Engineering (BUM) |
|
|
|
Bogazici University |
|
|
| 2 : | France Télécom Recherche & Développement (FT R&D) |
|
|
|
France Télécom |
|
|
| 3 : | Grenoble Images Parole Signal Automatique (GIPSA-lab) |
|
|
|
CNRS : UMR5216 – Université Joseph Fourier - Grenoble I – Université Pierre Mendès-France - Grenoble II – Université Stendhal - Grenoble III – Institut Polytechnique de Grenoble |
|
|
|
|
|
|
|
|
|
| GPIG |
|
|
|
|
| Domaine | : | Informatique/Vision par ordinateur et reconnaissance de formes Informatique/Interface homme-machine |
|
|
| Liste des fichiers attachés à ce document : | |||||
|
|||||
|
|
|
| hal-00327779, version 1 | |
| http://hal.archives-ouvertes.fr/hal-00327779 | |
| oai:hal.archives-ouvertes.fr:hal-00327779 | |
| Contributeur : Thomas Burger | |
| Soumis le : Jeudi 9 Octobre 2008, 14:40:09 | |
| Dernière modification le : Vendredi 17 Juin 2011, 14:02:37 | |
