Image and Video for hearing impaired people

Alice Caplier (1) , Sébastien Stillittano (1) , Oya Aran (2) , Lale Akarun (2) , Gérard Bailly (3) , Denis Beautemps (3) , Noureddine Aboutabit (3) , Thomas Burger (4)

1 GIPSA-GPIG - GIPSA - Géométrie, Perception, Images, Geste
2 Department of Computer Engineering [Bogazici]
3 GIPSA-MPACIF - GIPSA - Machines Parlantes, Agents Communicants & Interaction Face-à-face
4 FT R&D - France Télécom Recherche & Développement

We present a global overview of image- and video-processing-based methods to help the communication of hearing impaired people. Two directions of communication have to be considered: from a hearing person to a hearing impaired person and vice versa. In this paper, firstly, we describe sign language (SL) and the cued speech (CS) language which are two different languages used by the deaf community. Secondly, we present existing tools which employ SL and CS video processing and recognition for the automatic communication between deaf people and hearing people. Thirdly, we present the existing tools for reverse communication, from hearing people to deaf people that involve SL and CS video synthesis

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Alice Caplier, Sébastien Stillittano, Oya Aran, Lale Akarun, Gérard Bailly, et al.. Image and Video for hearing impaired people. EURASIP Journal on Image and Video Processing, 2007, 2007, pp.ID 45641. ⟨10.1155/2007/45641⟩. ⟨hal-00275029⟩