Une assistance à l'interaction 3D en réalité virtuelle par un raisonnement sémantique et une conscience du contexte

Abstract : Tasks in immersive virtual environments are associated with 3D interaction techniques and devices (e.g. the selection of 3D objects with the virtual hand and a flystick). As environments and tasks become more and more complex, techniques can not remain the same for each application, even for every situations of a single application. A solution is to adapt the interaction depending on the situation in order to increase usability. These adaptations can be done manually by the designer or the user, or automatically by the system thus creating an adaptative interaction. Formalisation of such assistance needs the management of pertinent information regarding the situation. Those items of information make the context emerge from the interaction. The adaptative assistance obtained by reasoning on this information is then context-aware. Numerous possibilities can be used to build one. Our objective is a context management that preserves its high degrees of expressiveness and evolutivity while being easy to plug in. We have built a model for this issue using conceptual graphs based on an ontology and managed externally with a first order logic engine. The engine is generic and uses a knowledge base with facts and rules which can be dynamically changed. We have added a confidence notion, in order to establish a situation similarity to the knowledge base. Reactions' confidences are compared to their impacts so as to keep only the pertinent ones while avoiding user overload. Applications have tools that can be controlled by the engine. Sensors are used to extract semantic information for the context. Effectors are used to act upon the application and to have adaptations. A tools set and a knowledge base have been created for 3D interaction. Numerous steps have been added in the knowledge base to obtain good combinations and a reasoning independent from specific tools. Our first applications shows the situation understanding, including user interests and difficulties, and the triggering of pertinent assistances. An off-line study illustrates the access and evolution of the internal engine steps. The built generic semantic reasoning is expressive, understandable, extensive and modifiable dynamically. For 3D interaction, it allows universal assistances for the user that can be automatic, punctual or manual and off-line activities or conceptions analysis for the designers.
Complete list of metadatas

Cited literature [87 references]  Display  Hide  Download

https://tel.archives-ouvertes.fr/tel-00903529
Contributor : Frédéric Davesne <>
Submitted on : Tuesday, November 12, 2013 - 1:42:32 PM
Last modification on : Monday, October 28, 2019 - 11:00:21 AM
Long-term archiving on: Thursday, February 13, 2014 - 12:25:38 PM

Identifiers

  • HAL Id : tel-00903529, version 1

Collections

Citation

Yannick Dennemont. Une assistance à l'interaction 3D en réalité virtuelle par un raisonnement sémantique et une conscience du contexte. Interface homme-machine [cs.HC]. Université d'Evry-Val d'Essonne, 2013. Français. ⟨tel-00903529⟩

Share

Metrics

Record views

338

Files downloads

909