A Weighted Superposition of Functional Contours Model for Modelling Contextual Prominence of Elementary Prosodic Contours

Abstract : The way speech prosody encodes linguistic, paralinguistic and non-linguistic information via multiparametric representations of the speech signals is still an open issue. The Superposi-tion of Functional Contours (SFC) model proposes to decompose prosody into elementary multiparametric functional contours through the iterative training of neural network contour generators using analysis-by-synthesis. Each generator is responsible for computing multiparametric contours that encode one given linguistic, paralinguistic and non-linguistic information on a variable scope of rhythmic units. The contributions of all generators' outputs are then overlapped and added to produce the prosody of the utterance. We propose an extension of the contour generators that allows them to model the prominence of the elementary contours based on contextual information. WSFC jointly learns the patterns of the elementary multi-parametric functional contours and their weights dependent on the contours' contexts. The experimental results show that the proposed weighted SFC (WSFC) model can successfully capture contour prominence and thus improve SFC modelling performance. The WSFC is also shown to be effective at modelling the impact of attitudes on the prominence of functional contours cuing syntactic relations in French, and that of emphasis on the prominence of tone contours in Chinese.
Document type :
Conference papers
Complete list of metadatas

Cited literature [15 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01921906
Contributor : Gérard Bailly <>
Submitted on : Wednesday, November 14, 2018 - 10:51:04 AM
Last modification on : Thursday, March 7, 2019 - 8:05:02 PM
Long-term archiving on : Friday, February 15, 2019 - 1:13:40 PM

File

1286.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Branislav Gerazov, Gérard Bailly, Yi Xu. A Weighted Superposition of Functional Contours Model for Modelling Contextual Prominence of Elementary Prosodic Contours. 19th Annual Conference of the International Speech Communication Association (Interspeech 2018), Sep 2018, Hyderabad, India. ⟨10.21437/interspeech.2018-1286⟩. ⟨hal-01921906⟩

Share

Metrics

Record views

42

Files downloads

100