A Lightweight AV System for Providing a Faithful and Spatially Manipulable Visual Hand Representation

Andreas Pusch 1, 2 Olivier Martin 3 Sabine Coquillart 4, *
* Corresponding author
1 I3D - 3 dimensional interaction
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
2 LIG Laboratoire d'Informatique de Grenoble - IIHM
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
3 GIPSA-SAIGA - SAIGA
GIPSA-DA - Département Automatique, GIPSA-DIS - Département Images et Signal
4 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : This paper introduces the technical foundations of a system designed to embed a lightweight, faithful and spatially manipulable representation of the user's hand into an otherwise virtual world (aka Augmented Virtuality, AV). A highly intuitive control during pointing-like near space interaction can be provided to the user as well as a very flexible means to experimenters in a variety of non-medical and medical contexts. Our approach essentially relies on stereoscopic video seethrough Augmented Reality (AR) technology and a generic, extendible framework for managing 3D visual hand displacements. Research from human-computer interaction, perception and motor control has contributed to the elaboration of our proposal which combines a) acting in co-location, b) avoiding occlusion violations by assuring a correct scene depth ordering and c) providing a convincing visual feedback of the user's hand. We further present two cases in which this system has already successfully been used and then line out some other applications that we think are promising, for instance, in the fields of neuromotor rehabilitation and experimental neuroscience.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00642186
Contributor : Olivier Martin <>
Submitted on : Wednesday, January 9, 2013 - 6:06:55 PM
Last modification on : Thursday, October 24, 2019 - 10:35:48 AM
Long-term archiving on : Wednesday, April 10, 2013 - 2:35:10 AM

File

Pusch-Martin-Coquillart_CyberT...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00642186, version 1

Citation

Andreas Pusch, Olivier Martin, Sabine Coquillart. A Lightweight AV System for Providing a Faithful and Spatially Manipulable Visual Hand Representation. CyberTherapy 16 - CyberPsychology and CyberTherapy Conference, Jun 2011, Gatineau, Canada. 5p. ⟨hal-00642186⟩

Share

Metrics

Record views

687

Files downloads

214