Skip to Main content Skip to Navigation
Conference papers

Cultural differences in pattern matching: multisensory recognition of socio-affective prosody

Abstract : This study focuses on the cross-cultural differences in perception of audio visual prosodic recordings of Japanese social affects, which have been largely uninvestigated. The study compares cultural differences of perceptual patterns of 21 Japanese subjects with 20 French subjects who have no knowledge of Japanese language or Japanese social affects. The test material was a semantically affectively neutral utterance expressed in 9 various social affects by 2 Japanese speakers (one male, one female) who were recognized as best performers in our previous recognition experiment. The perception test task was to first choose the speaker’s intended social affective meaning from the audio alone and also the video alone presentations, using a forced choice paradigm. The next task was to match the audio (no video) with the video (no audio) information. The results revealed that the native subjects could correctly combine auditory and visually expressed social affects, showing some confusion inside semantic categories. Different matching patterns were seen for non-native subjects.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01314830
Contributor : Aurélie Bugeau <>
Submitted on : Thursday, May 12, 2016 - 10:57:34 AM
Last modification on : Monday, March 16, 2020 - 10:58:02 AM

Identifiers

  • HAL Id : hal-01314830, version 1

Citation

Takaaki Shochi, Jean-Luc Rouas, Ming Zuheng, Marine Guerry, Aurélie Bugeau, et al.. Cultural differences in pattern matching: multisensory recognition of socio-affective prosody. International Congress of Psychology (ICP), Jul 2016, Yokohama, Japan. ⟨hal-01314830⟩

Share

Metrics

Record views

288