3D interaction assistance in virtual reality: a semantic reasoning engine for context-awareness

Yannick Dennemont (1) , Guillaume Bouyer (1) , Samir Otmane (1) , Malik Mallem (1)

1 IBISC - Informatique, Biologie Intégrative et Systèmes Complexes

This work focuses on 3D interaction assistance by adding adaptivity depending on the tasks, the objectives, and the general in- teraction context. An engine to reach context-awareness has been im- plemented in Prolog+CG which uses Conceptual Graphs (CGs) based on an ontology. CGs descriptions of the available sensors and actua- tors in our scene manager (Virtools) allow the engine to take decisions and send them through Open Sound Control (OSC). Measurements and adaptations corresponding to speci c tools uses are decided from rules handled by the engine. This project is a step towards Intelligent Virtual Environments, which proposes a hybrid solution by adding a separate semantic reasoning to classic environments. The rst experiment auto- matically manages few modalities depending on the distance to objects, user movement, available tools, etc. Gestures are used both as an engine direct control and as an interpretation of user activity.

Mots clés: Interaction Techniques; Context-awareness; Knowledge Representation Formalism and Methods; Virtual reality

Domaines: Interface homme-machine [cs.HC]; Intelligence artificielle [cs.AI]

Yannick Dennemont, Guillaume Bouyer, Samir Otmane, Malik Mallem. 3D interaction assistance in virtual reality: a semantic reasoning engine for context-awareness. the International Conference on Context-Aware Systems and Applications (ICCASA 2012), Nov 2012, Ho Chi Minh City, Vietnam. pp.30--40, ⟨10.1007/978-3-642-36642-0_4⟩. ⟨hal-00762356⟩