Visual lip information supports auditory word segmentation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Visual lip information supports auditory word segmentation

Résumé

Word segmentation is one of the initial processes that needs to be solved when acquiring the first or learning a second language. Acoustic cues like the fundamental frequency and segment durations have been shown to facilitate the detection of word boundaries. The role of visual speech and in particular of lip movements in word segmentation is still rather unknown. In French, liaisons, e.g. between determiner and noun, often pose a problem of several segmentation possibilities (e.g., the sequence /lafiS/ with liaison ("l’affiche") means the poster whereas without liaison ("la fiche") it means the file.). Here, we use 17 ambiguous French sequences with and without liaison. They were presented in carrier sentences either with clear acoustic cues for the first or the second segmentation possibility or with ambiguous acoustic cues. The three audio conditions were combined with lip movements hyper-articulating either the first or the second segmentation possibility in order to observe the influence of visual information on segmentation. Theparticipants had to indicate as quickly as possible which of the two versions they understood (e.g., "l’affiche" or "la fiche"?). Results show that lip information indeed biases the word segmentation decision. These data provide important implications for audiovisual integration processes.
Fichier principal
Vignette du fichier
Strauss_AVSP2015.pdf (3.9 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

halshs-01298351 , version 1 (05-04-2016)

Identifiants

  • HAL Id : halshs-01298351 , version 1

Citer

Antje Strauss, Christophe Savariaux, Sonia Kandel, Jean-Luc Schwartz. Visual lip information supports auditory word segmentation. FAAVSP 2015 - 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing, Sep 2015, Vienne, Austria. ⟨halshs-01298351⟩
570 Consultations
130 Téléchargements

Partager

Gmail Facebook X LinkedIn More