3D-CNN for Facial Emotion Recognition in Videos - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

3D-CNN for Facial Emotion Recognition in Videos

Résumé

In this paper, we present a video-based emotion recognition neural network operating on three dimensions. We show that 3D convo-lutional neural networks (3D-CNN) can be very good for predicting facial emotions that are expressed over a sequence of frames. We optimize the 3D-CNN architecture through hyper-parameters search, and prove that this has a very strong influence on the results, even if architecture tuning of 3D CNNs has not been much addressed in the literature. Our proposed resulting architecture improves over the results of the state-of-the-art techniques when tested on the CK+ and Oulu-CASIA datasets. We compare the results with cross-validation methods. The designed 3D-CNN yields a 97.56% using Leave-One-Subject-Out cross-validation, and 100% using 10-fold cross-validation on the CK+ dataset, and 84.17% using 10-fold cross-validation on the Oulu-CASIA dataset.
Fichier principal
Vignette du fichier
ISVC2020.pdf (303.42 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02955528 , version 1 (02-10-2020)

Identifiants

  • HAL Id : hal-02955528 , version 1

Citer

Jad Haddad, Olivier Lézoray, Philippe Hamel. 3D-CNN for Facial Emotion Recognition in Videos. International Symposium on Visual Computing, Oct 2020, San Diego (Virtual), United States. ⟨hal-02955528⟩
178 Consultations
1567 Téléchargements

Partager

Gmail Facebook X LinkedIn More