Towards an Automatic Annotation of French Sign Language Videos: Detection of Lexical Signs - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Towards an Automatic Annotation of French Sign Language Videos: Detection of Lexical Signs

Résumé

This paper presents an approach towards an automatic annotation system for French Sign Language (LSF). Such automation aims to reduce the processing time and the subjectivity of manual annotations done by linguists in order to study the sign language and simplify indexing for automatic signs recognition. The described system uses face and body keypoints collected from 2D RGB standard LSF videos. A naive Bayesian model was built to classify gestural units using the collected keypoints as features. We started from the observation that, for many signers, the production of lexical signs is very often accompanied by mouthing. Effectively, the results showed that the system is capable of detecting lexical signs, with highest success rate, using only information about mouthing and head direction.
Fichier principal
Vignette du fichier
Springer_Lecture_Notes_in_Computer_Science__1_.pdf (1.9 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03058012 , version 1 (05-01-2021)

Identifiants

Citer

Hussein Chaaban, Michèle Gouiffès, Annelies Braffort. Towards an Automatic Annotation of French Sign Language Videos: Detection of Lexical Signs. CAIP 2019: Computer Analysis of Images and Patterns, Sep 2019, Salerno, Italy. pp.402-412, ⟨10.1007/978-3-030-29891-3_35⟩. ⟨hal-03058012⟩
57 Consultations
86 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More