1076 articles – 553 references  [version française]
HAL: hal-00472794, version 1

Short view  Export this paper
Multimodal human machine interactions in virtual and augmented reality
Chollet G., Esposito A., Gentes A., Horain P., Karam W., Li Z., Pelachaud C., Perrot P., Petrovska-Delacrétaz D., Zhou D. et al
in Multimodal Signals : Cognitive and Algorithmic Issues : COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008 Revised Selected and Invited Papers (2009) 1-23 - http://hal.archives-ouvertes.fr/hal-00472794
Scientific Book chapter
Multimodal human machine interactions in virtual and augmented reality
Gérard Chollet 1, Anna Esposito 2, Annie Gentes 1, Patrick Horain 3, Walid Karam 1, Zhenbo Li 3, Catherine Pelachaud 1, Patrick Perrot 4, Dijana Petrovska-Delacrétaz 3, Dianle Zhou () 3, Leila Zouhari 1
1:  Département Traitement du Signal et des Images (TSI)
Télécom ParisTech – CNRS : UMR5141
46, rue Barrault 75013 PARIS
France
2:  Istituto Internazionale per gli Alti Studi Scientifici (IIASS)
Istituto Internazionale per gli Alti Studi Scientifici
Via G. Pellegrino - Vietri sul Mare
Italy
3:  Département Electronique et Physique (EPH)
Institut Mines-Télécom – Télécom SudParis
France
4:  Institut de Recherche Criminelle de la Gendarmerie Nationale (IRCGN)
Ministère de l'intérieur, de l'outre-mer et des collectivités territoriales
Rosny sous Bois
France
Virtual worlds are developing rapidly over the Internet. They are visited by avatars and staffed with Embodied Conversational Agents (ECAs). An avatar is a representation of a physical person. Each person controls one or several avatars and usually receives feedback from the virtual world on an audio-visual display. Ideally, all senses should be used to feel fully embedded in a virtual world. Sound, vision and sometimes touch are the available modalities. This paper reviews the technological developments which enable audio-visual interactions in virtual and augmented reality worlds. Emphasis is placed on speech and gesture interfaces, including talking face analysis and synthesis.
English

Multimodal Signals : Cognitive and Algorithmic Issues : COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008 Revised Selected and Invited Papers
Springer-Verlag
2009
1-23
Lecture Notes in Computer Science

Human Machine Interactions (HMI) – Multimodality – Speech – Face – Gesture – Virtual words
7360