A Methodology for the Automatic Extraction and Generation of Non-Verbal Signals Sequences Conveying Interpersonal Attitudes

Abstract : —Depending on their application, Embodied Conversational Agents (ECAs) must be able to express various affects or social constructs such as emotions or social attitudes. Non-verbal signals, such as smiles or gestures, contribute to the expression of attitudes. Social attitudes affect the whole behavior of a person: as Scherer puts it, they are " characteristic of an affective style that colors the entire interaction " [1]. Moreover, recent findings have demonstrated that non-verbal signals are not interpretated in isolation but along with surrounding signals: for instance, a smile followed by a gaze aversion and a head aversion may signal embarassment rather than amusement [2]. Non-verbal behavior planning models designed to allow ECAs to express attitudes should thus consider complete sequences of non-verbal signals and not only signals independently of one another. However, existing models do not take this into account, or in a limited manner. The contribution of this paper is a methodology for the automatic extraction of sequences of non-verbal signals characteristic of a social phenomenon from a multimodal corpus, and a non-verbal behavior planning model that takes into account sequences of non-verbal signals rather than signals independently. This methodology is applied to design a virtual recruiter capable of expressing social attitudes, which is then evaluated in and out of an interaction context.
Type de document :
Article dans une revue
IEEE Transactions on Affective Computing, 2017, XX, pp.1 - 1. 〈10.1109/TAFFC.2017.2753777〉
Liste complète des métadonnées

Littérature citée [92 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01793271
Contributeur : Magalie Ochs <>
Soumis le : vendredi 18 mai 2018 - 15:16:56
Dernière modification le : mercredi 6 juin 2018 - 10:45:08

Fichier

tac_v4.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Magalie Ochs, Mathieu Chollet, Catherine Pelachaud. A Methodology for the Automatic Extraction and Generation of Non-Verbal Signals Sequences Conveying Interpersonal Attitudes. IEEE Transactions on Affective Computing, 2017, XX, pp.1 - 1. 〈10.1109/TAFFC.2017.2753777〉. 〈hal-01793271〉

Partager

Métriques

Consultations de la notice

60

Téléchargements de fichiers

7