Skip to Main content Skip to Navigation
Conference papers

Synthesizing speech-like emotional expression onto music and speech signals

Laura Rachman 1 Marco Liuni 1 Pablo Arias 1 Jean-Julien Aucouturier 1
1 Equipe Perception et design sonores
STMS - Sciences et Technologies de la Musique et du Son
Abstract : The workshop is a one-hour hands-on session in which participants will learn to use a new, free software tool able to synthesize markers of speech-like emotional expression, incl. pitch inflections, vibrato, and spectral envelope manipulations, onto any pre-existing music, speech or audio stimuli. Tested on speech, the effects are reliably recognized as emotional; they can produce emotions of varying controllable intensities; and they are not typically detected as artificially produced. In addition, they run in less than 15 milliseconds, allowing the tool to modify emotional expression on the fly in social situations, naturally and surreptitiously. In this workshop, participants will learn to use the software, and practice applying the effects both speech and music stimuli. Applied to speech, the effects will allow to systematically control for the nature and intensity of the expressive cues in e.g. imaging stimuli. Applied to musical signals, these effects will allow to test for the cognitive mechanisms involved in decoding speech-like emotional cues in music, and whether these differ from those involved in emotional speech. Participants will leave the workshop with a running copy of the software on their laptop, and - we hope - with a few experimental ideas to try back home.
Keywords : music speech emotion
Complete list of metadata
Contributor : Jean-Julien Aucouturier <>
Submitted on : Sunday, January 24, 2016 - 8:43:47 AM
Last modification on : Friday, January 8, 2021 - 2:04:39 PM


  • HAL Id : hal-01261133, version 1


Laura Rachman, Marco Liuni, Pablo Arias, Jean-Julien Aucouturier. Synthesizing speech-like emotional expression onto music and speech signals. Fifth International Conference on Music and Emotions, (ICME4), Oct 2015, Geneva, Switzerland. ⟨hal-01261133⟩



Record views