Vishnu: Virtual Immersive Support for HelpiNg Users - An Interaction Paradigm for Collaborative Remote Guiding in Mixed Reality

Morgan Le Chénéchal (1) , Thierry Duval (2, 3, 1) , Valérie Gouranton (4, 5, 1) , Jérôme Royan (1) , Bruno Arnaldi (5, 4, 1)

1 Hypermedia - Domaine Hypermedia (IRT b<>com)
2 Lab-STICC_TB_CID_IHSEV
3 LUSSI - Département Logique des Usages, Sciences sociales et Sciences de l'Information
4 Hybrid - 3D interaction with virtual environments using body and mind
5 INSA Rennes - Institut National des Sciences Appliquées - Rennes

Increasing networking performances as well as the emergence of Mixed Reality (MR) technologies make possible providing advanced interfaces to improve remote collaboration. In this paper, we present our novel interaction paradigm called Vishnu that aims to ease collaborative remote guiding. We focus on collaborative remote maintenance as an illustrative use case. It relies on an expert immersed in Virtual Reality (VR) in the remote workspace of a local agent helped through an Augmented Reality (AR) interface. The main idea of the Vishnu paradigm is to provide the local agent with two additional virtual arms controlled by the remote expert who can use them as interactive guidance tools. Many challenges come with this: collocation, inverse kinematics (IK), the perception of the remote collaborator and gestures coordination. Vishnu aims to enhance the maintenance procedure thanks to a remote expert who can show to the local agent the exact gestures and actions to perform. Our pilot user study shows that it may decrease the cognitive load compared to a usual approach based on the mapping of 2D and de-localized informations, and it could be used by agents in order to perform specific procedures without needing to have an available local expert.

Mots clés: Virtual Reality; Mixed Reality; 3D User Interaction; Collaborative Virtual Environments; Augmented Reality

Domaines: Ordinateur et société [cs.CY]; Synthèse d'image et réalité virtuelle [cs.GR]

Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan, Bruno Arnaldi. Vishnu: Virtual Immersive Support for HelpiNg Users - An Interaction Paradigm for Collaborative Remote Guiding in Mixed Reality. 3DCVE 2016 : International Workshop on Collaborative Virtual Environments, Mar 2016, Greenville, États-Unis. pp.1 - 5, ⟨10.1109/3DCVE.2016.7563559⟩. ⟨hal-01293435⟩