Navigation and interaction in a real-scale digital mock-up using natural language and user gesture

Mohammad Ali Mirzaei (1) , Jean-Rémy Chardonnet (1) , Frédéric Merienne (1) , A. Genty (2)

1 Le2i - Laboratoire Electronique, Informatique et Image [UMR6306]
2 Bouygues Bâtiment International

This paper tries to demonstrate a very new real-scale 3D system and sum up some firsthand and cutting edge results concerning multi-modal navigation and interaction interfaces. This work is part of the CALLISTO-SARI collaborative project. It aims at constructing an immersive room, developing a set of software tools and some navigation/interaction interfaces. Two sets of interfaces will be introduced here: 1) interaction devices, 2) natural language (speech processing) and user gesture. The survey on this system using subjective observation (Simulator Sickness Questionnaire, SSQ) and objective measurements (Center of Gravity, COG) shows that using natural languages and gesture-based interfaces induced less cyber-sickness comparing to device-based interfaces. Therefore, gesture-based is more efficient than device-based interfaces.

Mots clés: Gesture perception; Speech processing; Interaction/Navigation interfaces; Real-time signal processing; Full-scale immersive 3D system

Domaines: Interface homme-machine [cs.HC]; Synthèse d'image et réalité virtuelle [cs.GR]

Mohammad Ali Mirzaei, Jean-Rémy Chardonnet, Frédéric Merienne, A. Genty. Navigation and interaction in a real-scale digital mock-up using natural language and user gesture. Laval Virtual VRIC'14, Apr 2014, France. pp.1-4. ⟨hal-00981165⟩