The cognition of auditory smiles: a computational approach

Abstract : Emotions are the fuel of human survival and social development. Not only do we undergo primitive reflexes mediated by ancient brain structures, but we also consciously and unconsciously regulate our emotions in social contexts, affiliating with friends and distancing from foes. One of our main tools for emotion regulation is facial expression and, in particular, smiles. Smiles are deeply grounded in human behavior: they develop early, and are used across cultures to communicate affective states. The mechanisms that under- lie their cognitive processing include interactions not only with visual, but also emotional and motor systems. Smiles, trigger facial imitation in their observers, reactions thought to be a key component of the human capacity for empathy. Smiles, however, are not only experienced visually, but also have audible consequences. Although visual smiles have been widely studied, almost nothing is known about the cognitive processing of their auditory counterpart. This is the aim of this dissertation. In this work, we characterise and model the smile acoustic fingerprint, and use it to probe how auditory smiles are processed cognitively. We give here evidence that (1) auditory smiles can trigger unconscious facial imitation, that (2) they are cognitively integrated with their visual counterparts during perception, and that (3) the develop- ment of these processes does not depend on pre-learned visual associations. We conclude that the embodied mechanisms associated to the visual process- ing of facial expressions of emotions are in fact equally found in the auditory modality, and that their cognitive development is at least partially independent from visual experience.
Complete list of metadatas

Cited literature [306 references]  Display  Hide  Download
Contributor : Ircam Ircam <>
Submitted on : Monday, January 28, 2019 - 5:52:19 PM
Last modification on : Saturday, March 23, 2019 - 1:39:55 AM


Files produced by the author(s)


  • HAL Id : tel-01997203, version 1


Pablo Arias Sarah. The cognition of auditory smiles: a computational approach. Cognitive Sciences. Sorbonne universités, 2018. English. ⟨tel-01997203⟩



Record views


Files downloads