A hybrid formalism to parse sign languages

Rémi Dubot (1) , Christophe Collet (1, 2)

1 IRIT-TCI - Traitement et Compréhension d’Images
2 UT3 - Université Toulouse III - Paul Sabatier

Sign Language (SL) linguistic is dependent on the expensive task of annotating. Some automation is already available for low-level information (eg. body part tracking) and the lexical level has shown significant progresses. The syntactic level lacks annotated corpora as well as complete and consistent models. This article presents a solution for the automatic annotation of SL syntactic elements. It exposes a formalism able to represent both constituency-based and dependency-based models. The first enable the representation the structures one may want to annotate, the second aims at fulfilling the holes of the first. A parser is presented and used to conduct two experiments on the solution. One experiment is on a real corpus, the other is on a synthetic corpus.

Mots clés: Sign Languages; Hybrid formalism

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]; Intelligence artificielle [cs.AI]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement des images [eess.IV]; Traitement du signal et de l'image [eess.SP]

Rémi Dubot, Christophe Collet. A hybrid formalism to parse sign languages. 9th edition of the Language Resources and Evaluation Conference (LREC 2014), May 2014, Reykjavik, Iceland. pp.1-48. ⟨hal-01137244⟩