Pointing to a target while naming it with /pata/ or /tapa/: the effect of consonants and stress position on jaw-finger coordination

Amélie Rochet-Capellan (1) , Jean-Luc Schwartz (2) , Rafael Laboissière (3) , Arturo Galvan (3)

1 GIPSA-lab - Grenoble Images Parole Signal Automatique
2 GIPSA-PMD - GIPSA - Parole, Multimodalité, Développement
3 IMPNSC - Max Planck Institute for Human Cognitive and Brain Sciences [Leipzig]

This study investigates jaw-finger coordination in a task consisting in pointing to a target while naming it with a /pata/ or a /tapa/ utterance stressed either on the first ('CVCV) or on the second (CV'CV) syllable. Optotrack measurements of jaw and finger displacements show that for 'CVCV names, the moment at with the finger reaches the target alignment is synchronized with the maximum of the first jaw opening motion. For CV'CV names, the synchronization occurs between the moment at which the finger leaves the target-alignment position and the maximum of the jaw opening motion for the second vowel. This pattern of synchronization does not depend on the target position or on the consonants order. These results add some support to theories involving the coordination of orofacial and brachiomanual gestures in the development and phylogeny of human languages. They call for more investigations on the link between speech and brachiomanual gestures in face-to-face communication.

Domaines: Psychologie; Linguistique

Amélie Rochet-Capellan, Jean-Luc Schwartz, Rafael Laboissière, Arturo Galvan. Pointing to a target while naming it with /pata/ or /tapa/: the effect of consonants and stress position on jaw-finger coordination. Interspeech 2007 - 8th Annual Conference of the International Speech Communication Association, Aug 2007, Antwerp, Belgium. pp.634-637. ⟨hal-00195361⟩