The influence of the communicative relationship between manual gesture and speech on their temporal coordination in a designation task

Benjamin Roustan (1) , Marion Dohen (1)

1 GIPSA-PCMD - GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole

An important observation which can be made from most of the studies on speech/gesture coordination is that the results are highly variable from one study to another. The nature of the communicative relationship between gesture and speech may be one factor explaining those discrepancies. The aim of this study is to further explore the possible modulation of speech / gesture coordination by the communicative relationship between gesture and speech. In order to do so, we designed a paradigm very close to that used in a previous experiment in which we varied the communicative relationship between the pointing gesture and speech within the designa- tion framework. In the aforementionned experiment, the pointing gesture and prosodic focus designated exactly the same object while in the present study, prosodic focus designated only one aspect of the information carried by both the entire spoken utterance and the visual target pointed at.

Mots clés: communicative link; beat; pointing; manual gesture; gesture; focus; prosody; lien communicatif; battement; pointage; pointer; geste manuel; geste; focalisation; prosodie

Domaines: Psychologie

Benjamin Roustan, Marion Dohen. The influence of the communicative relationship between manual gesture and speech on their temporal coordination in a designation task. ISSP 2011 - 9th International Seminar on Speech Production, Jun 2011, Montreal, Québec, Canada. pp.179-180. ⟨hal-00642469⟩