The Relationship Between F0 Synchrony and Speech Convergence in Dyadic Interaction

Sankar Mukherjee (1) , Alessandro d'Ausilio (1) , Noël Nguyen (2) , Luciano Fadiga (1, 3) , Leonardo Badino (1)

1 IIT - Istituto Italiano di Tecnologia
2 LPL - Laboratoire Parole et Langage
3 Human Physiology

Speech accommodation happens when two people engage in verbal conversation. In this paper two types of accommodation are investigated – one dependent on cognitive, physiological, functional and social constraints (Convergence), the other dependent on linguistic and paralinguistic factors (Synchrony). Convergence refers to the situation when two speakers' speech characteristics move towards a common point. Synchrony happens if speakers' prosodic features become correlated over time. Here we analyze relations between the two phenomena at the single word level. Although calculation of Synchrony is fairly straightforward, measuring Convergence is even more problematic as proved by a long history of debates on how to define it. In this paper we consider Convergence as an emergent behavior and investigate it by developing a robust and automatic method based on Gaussian Mixture Model (GMM). Our results show that high Synchrony of F0 between two speakers leads to greater amount of Convergence. This provides robust support for the idea that Synchrony and Convergence are interrelated processes, particularly in female participants.

Mots clés: Speech Synchrony; human-human interaction; Speech Convergence

Domaines: Linguistique

Sankar Mukherjee, Alessandro d'Ausilio, Noël Nguyen, Luciano Fadiga, Leonardo Badino. The Relationship Between F0 Synchrony and Speech Convergence in Dyadic Interaction. Interspeech 2017, Aug 2017, Stockholm, Sweden. pp.2341-2345, ⟨10.21437/Interspeech.2017-795⟩. ⟨hal-01579789⟩