HAL : hal-00256660, version 1

Fiche détaillée

Récupérer au format BibTeX - EndNote - TEI - RefWorks -

Journal of Multimodal User Interface 1, 1 (2007) 49-58

Multimodal signal processing and interaction for a driving simulator : component-based architecture

Alexandre Benoit 1, Laurent Bonnaud 1, Alice Caplier 1, I. Damousis 2, F. Jourde 3, J.-Y. L. Lawson 4, L. Nigay 3, M. Serrano 3, D. Tzovaras 2

Similar Collaboration(s)

(01/03/2007)

In this paper we focus on the design and development of a multimodal driving simulator that is based on both multimodal driver's focus of attention detection as well as driver's fatigue state detection and prediction. Capturing and interpreting the driver's focus of attention and fatigue state will be based on video data (e.g., facial expression, head movement, eye tracking). While the input multimodal interface relies on passive modalities only (also called attentive user interface), the output multimodal user interface includes several active output modalities for presenting alert messages including graphics and text on a mini-screen and in the windshield, sounds, speech and vibration (vibration wheel). Active input modalities are added in the meta-User Interface to let the user dynamically select the output modalities. The driving simulator is used as a case study for studying software architecture for multimodal signal processing and multimodal interaction using two software component-based platforms, OpenInterface and ICARE.

1 :	Grenoble Images Parole Signal Automatique (GIPSA-lab)
	CNRS : UMR5216 – Université Joseph Fourier - Grenoble I – Université Pierre-Mendès-France - Grenoble II – Université Stendhal - Grenoble III – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
2 :	Centre for Research & Technology Hellas (CERTH)
	CERTH
3 :	Laboratoire d'Informatique de Grenoble (LIG)
	Université Joseph Fourier - Grenoble I – Institut Polytechnique de Grenoble - Grenoble Institute of Technology – Université Pierre-Mendès-France - Grenoble II – CNRS : UMR5217
4 :	Université Catholique de Louvain (UCL)
	Université Catholique de Louvain (UCL) - Belgique

Équipe de recherche : GPIG

Domaine

:

Informatique/Traitement du signal et de l'image Sciences cognitives/Informatique Informatique/Interface homme-machine Sciences de l'ingénieur/Traitement du signal et de l'image

Mots Clés : Attention level – Component – Driving simulator – Facial movement analysis – ICARE – Interaction modality – OpenInterface – Software architecture – Multimodal interaction

hal-00256660, version 1

http://hal.archives-ouvertes.fr/hal-00256660

oai:hal.archives-ouvertes.fr:hal-00256660

Contributeur : Alexandre Benoit <>

Soumis le : Vendredi 22 Février 2008, 11:50:14

Dernière modification le : Mercredi 3 Avril 2013, 16:42:39