Encodage de la distance et coopération parole/geste : étude développementale du pointage multimodal

Chloe Gonseth (1) , Coriandre Emmanuel Vilain (2) , Anne Vilain (1)

1 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole
2 GIPSA-Services - GIPSA-Services

The aim of this paper is to characterize, through the deictic process use, the speech/gesture interaction during language developement. Participants, both adults and children, had to designate with a deictic word and/or a deictic gesture a target, which could be either close or distant. The use of two vs one modality (speech and gesture) allowed us to attest a cooperation between the two systems, which take place in a complementary rather than redundant way. Furthermore, our results are in favour of a target's distance encoding, not only in articulatory cues of vocal pointing, but also in kinematic cues of manual pointing.

Domaines: Neurosciences

Chloe Gonseth, Coriandre Emmanuel Vilain, Anne Vilain. Encodage de la distance et coopération parole/geste : étude développementale du pointage multimodal. JEP-TALN-RECITAL 2012 - conférence conjointe 29e Journées d'Études sur la Parole, 19e Traitement Automatique des Langues Naturelles, 14e Rencontre des Étudiants Chercheurs en Informatique pour le Traitement Automatique des Langues, Jun 2012, Grenoble, France. pp.90. ⟨hal-00704612⟩