Cultural  differences  in  pattern matching: multisensory recognition of 
socio-affective prosody

Takaaki Shochi; Jean-Luc Rouas; Ming Zuheng; Marine Guerry; Aurélie Bugeau; Erickson Donna

Cultural differences in pattern matching: multisensory recognition of socio-affective prosody

Takaaki Shochi ^{1, 2} Jean-Luc Rouas ¹ Ming Zuheng ¹ Marine Guerry ² Aurélie Bugeau ¹ Erickson Donna ^{3, 4}

1 LaBRI - Laboratoire Bordelais de Recherche en Informatique

2 CLLE-ERSS - Cognition, Langues, Langage, Ergonomie

3 Sophia University Phonetics Laboratory

4 Kanazawa Medical University

Abstract : This study focuses on the cross-cultural differences in perception of audio visual prosodic recordings of Japanese social affects, which have been largely uninvestigated. The study compares cultural differences of perceptual patterns of 21 Japanese subjects with 20 French subjects who have no knowledge of Japanese language or Japanese social affects. The test material was a semantically affectively neutral utterance expressed in 9 various social affects by 2 Japanese speakers (one male, one female) who were recognized as best performers in our previous recognition experiment. The perception test task was to first choose the speaker’s intended social affective meaning from the audio alone and also the video alone presentations, using a forced choice paradigm. The next task was to match the audio (no video) with the video (no audio) information. The results revealed that the native subjects could correctly combine auditory and visually expressed social affects, showing some confusion inside semantic categories. Different matching patterns were seen for non-native subjects.

Keywords : cross-cultural differences social affects

Type de document :

Communication dans un congrès

International Congress of Psychology, Jul 2016, Yokohama, Japan

Domaine :

Sciences de l'Homme et Société / Psychologie

Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01314830
Contributeur : Aurélie Bugeau <>
Soumis le : jeudi 12 mai 2016 - 10:57:34
Dernière modification le : mercredi 23 mai 2018 - 17:58:05

Cultural differences in pattern matching: multisensory recognition of socio-affective prosody

Identifiants

Collections

Citation

Exporter

Métriques

164

Contact

Cultural differences in pattern matching: multisensory recognition of socio-affective prosody

Identifiants

Collections

Citation

Exporter

Partager

Métriques

164

Contact