SeaTouch: A haptic and auditory maritime environment for non visual cognitive mapping of blind sailors

Mathieu Simonnet (1) , Dan Jacobson (2) , Stéphane Vieilledent (1) , Jacques Tisseau (1)

1 CERV - Centre Européen de Réalité Virtuelle
2 University of Calgary

Navigating consists of coordinating egocentric and allocentric spatial frames of reference. Virtual environments have afforded researchers in the spatial community with tools to investigate the learning of space. The issue of the transfer between virtual and real situations is not trivial. A central question is the role of frames of reference in mediating spatial knowledge transfer to external surroundings, as is the effect of different sensory modalities accessed in simulated and real worlds. This challenges the capacity of blind people to use virtual reality to explore a scene without graphics. The present experiment involves a haptic and auditory maritime virtual environment. In triangulation tasks, we measure systematic errors and preliminary results show an ability to learn configurational knowledge and to navigate through it without vision. Subjects appeared to take advantage of getting lost in an egocentric ''haptic'' view in the virtual environment to improve performances in the real environment.

Mots clés: Navigation; spatial frames of reference; virtual reality; haptic; blind; sailing

Domaines: Interface homme-machine [cs.HC]; Psychologie

Mathieu Simonnet, Dan Jacobson, Stéphane Vieilledent, Jacques Tisseau. SeaTouch: A haptic and auditory maritime environment for non visual cognitive mapping of blind sailors. Lecture Notes in Computer Science, 2012, 5756, pp.212-226. ⟨hal-00764911⟩