Prediction-based learning for continuous emotion recognition in speech

Abstract : In this paper, a prediction-based learning framework is proposed for a continuous prediction task of emotion recognition from speech, which is one of the key components of affective computing in multimedia. The main goal of this framework is to utmost exploit the individual advantages of different regression models cooperatively. To this end, we take two widely used regression models for example , i.e., support vector regression and bidirectional long short-term memory recurrent neural network. We concatenate the two models in a tandem structure by different ways, forming a united cascaded framework. The outputs predicted by the former model are combined together with the original features as the input of the following model for final predictions. The experimental results on a time-and value-continuous spontaneous emotion database (RECOLA) show that, the prediction-based learning framework significantly outperforms the individual models for both arousal and valence dimensions , and provides significantly better results in comparison to other state-of-the-art methodologies on this corpus.
Liste complète des métadonnées

Cited literature [27 references]  Display  Hide  Download
Contributor : Fabien Ringeval <>
Submitted on : Wednesday, March 22, 2017 - 3:55:49 PM
Last modification on : Tuesday, February 12, 2019 - 1:31:19 AM
Document(s) archivé(s) le : Friday, June 23, 2017 - 1:50:00 PM


Files produced by the author(s)


Public Domain


  • HAL Id : hal-01494055, version 1



Jing Han, Zixing Zhang, Fabien Ringeval, Björn Schuller. Prediction-based learning for continuous emotion recognition in speech. Proceedings of the 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2017, New Orleans (LA), United States. ⟨hal-01494055⟩



Record views


Files downloads