Synthesizing speech-like emotional expression onto music and speech signals

Laura Rachman 1 Marco Liuni 1 Pablo Arias 1 Jean-Julien Aucouturier 1
1 Equipe Perception et design sonores
STMS - Sciences et Technologies de la Musique et du Son
Abstract : The workshop is a one-hour hands-on session in which participants will learn to use a new, free software tool able to synthesize markers of speech-like emotional expression, incl. pitch inflections, vibrato, and spectral envelope manipulations, onto any pre-existing music, speech or audio stimuli. Tested on speech, the effects are reliably recognized as emotional; they can produce emotions of varying controllable intensities; and they are not typically detected as artificially produced. In addition, they run in less than 15 milliseconds, allowing the tool to modify emotional expression on the fly in social situations, naturally and surreptitiously. In this workshop, participants will learn to use the software, and practice applying the effects both speech and music stimuli. Applied to speech, the effects will allow to systematically control for the nature and intensity of the expressive cues in e.g. imaging stimuli. Applied to musical signals, these effects will allow to test for the cognitive mechanisms involved in decoding speech-like emotional cues in music, and whether these differ from those involved in emotional speech. Participants will leave the workshop with a running copy of the software on their laptop, and - we hope - with a few experimental ideas to try back home.
Keywords : music speech emotion
Type de document :
Communication dans un congrès
Fifth International Conference on Music and Emotions, (ICME4), Oct 2015, Geneva, Switzerland
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01261133
Contributeur : Jean-Julien Aucouturier <>
Soumis le : dimanche 24 janvier 2016 - 08:43:47
Dernière modification le : jeudi 22 novembre 2018 - 14:32:29

Identifiants

  • HAL Id : hal-01261133, version 1

Collections

Citation

Laura Rachman, Marco Liuni, Pablo Arias, Jean-Julien Aucouturier. Synthesizing speech-like emotional expression onto music and speech signals. Fifth International Conference on Music and Emotions, (ICME4), Oct 2015, Geneva, Switzerland. 〈hal-01261133〉

Partager

Métriques

Consultations de la notice

203