A closed-form solution to the graph total variation problem for continuous emotion profiling in noisy environment

Abstract : Time-continuous emotion estimation (e. g., arousal and valence) from spontaneous speech expressions has recently drawn increasing commercial attention. However, real-life applications of emotion recognition technology require challenging conditions, such as noise from recording devices and background environments. In this work, we introduce a novel personalized emotion prediction model validated in different noisy environments. It is performed by a three-level noise reduction algorithm: (i) data downsampling, (ii) feature synchronization, and (iii) a modified version of graph total variation. The approach has been validated on the broadly used RECOLA database with different types of noises, including convolutive and additive noise with different SNRs. The process of feature synchronization improves the concordance correlation coefficient (CCC) absolute values by 0.271 on average for arousal and 0.137 for valence. The proposed denoising approach further improves the values by 0.101 for arousal and 0.086 for valence. Finally, the proposed model considerably improves the CCC values on raw data and all types of noisy data and outperforms the standard denoising methods
Document type :
Journal articles
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01993380
Contributor : Fabien Ringeval <>
Submitted on : Thursday, January 24, 2019 - 8:29:20 PM
Last modification on : Wednesday, February 13, 2019 - 1:05:00 AM

File

Jing18-AST.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Shaoling Jing, Xia Mao, Lijiang Chen, Maria Comes, Arianna Mencattini, et al.. A closed-form solution to the graph total variation problem for continuous emotion profiling in noisy environment. Speech Communication, Elsevier : North-Holland, 2018, 104, pp.66-72. ⟨10.1016/j.specom.2018.09.006⟩. ⟨hal-01993380⟩

Share

Metrics

Record views

10

Files downloads

9