Deep Learning for Image Memorability Prediction : the Emotional Bias

Yoann Baveye 1 Romain Cohendet 1 Matthieu Perreira da Silva 1 Patrick Le Callet 1
1 IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
Abstract : Image memorability prediction is a recent topic in computer science. First attempts have shown that it is possible to computationally infer from the intrinsic properties of an image the extent to which it is memorable. In this paper, we introduce a fine-tuned deep learning-based computational model for image memorability prediction. The performance of this model significantly outperforms previous work and obtains a 32.78% relative increase compared to the best-performing model from the state of the art on the same dataset. We also investigate how our model generalizes on a new dataset of 150 images, for which memorability and affective scores were collected from 50 participants. The prediction performance is weaker on this new dataset, which highlights the issue of representativity of the datasets. In particular, the model obtains a higher predictive performance for arousing negative pictures than for neutral or arousing positive ones, recalling how important it is for a memorability dataset to consist of images that are appropriately distributed within the emotional space.
Keywords : Computing methodologies → Computer vision Scene understanding •Human-centered computing → Human computer interaction (HCI) Image memorability Affect Deep learning
Document type :
Conference papers
Complete list of metadatas

Cited literature [25 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-01438323
Contributor : Matthieu Perreira da Silva <>
Submitted on : Tuesday, January 17, 2017 - 3:56:45 PM
Last modification on : Wednesday, September 11, 2019 - 11:00:02 AM
Long-term archiving on : Tuesday, April 18, 2017 - 3:03:41 PM

File

ACMM_paper_lastV.pdf
Files produced by the author(s)

Identifiers

Collections

EC-NANTES | IRCCYN | UNAM | UNIV-NANTES | IVC-IPI

Citation

Yoann Baveye, Romain Cohendet, Matthieu Perreira da Silva, Patrick Le Callet. Deep Learning for Image Memorability Prediction : the Emotional Bias. ACM Multimedia 2016, Oct 2016, Amsterdam, Netherlands. pp.491 - 495, ⟨10.1145/2964284.2967269⟩. ⟨hal-01438323⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

403

Files downloads

939

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD