Prototyping and Evaluating Sensory Substitution Devices by Spatial Immersion in Virtual Environments

Abstract : Various audio-vision Sensory Substitution Devices (SSDs) are in development to assist people without sight. They all convert optical information extracted from a camera, into sound parameters but are evaluated for different tasks in different contexts. The use of 3D environments is proposed here to compare the advantages and disadvantages of not only software (transcoding) solutions but also of hardware (component) specifics, in various situations and activities. By use of a motion capture system, the whole person, not just a guided avatar, was immersed in virtual places that were modelled and that could be replicated at will. We evaluated the ability to hear depth for various tasks: detecting and locating an open window, moving and crossing an open door. Participants directed the modelled depth-camera with a real pointing device that was either held in the hand or fastened on the head. Mixed effects on response delays were analyzed with a linear model to highlight the respective importance of the pointing device, the target specifics and the individual participants. Results are encouraging to further exploit our prototyping set-up and test many solutions by implementing e.g., environments, sensor devices, transcoding rules, and pointing devices including the use of an eye-tracker.
Type de document :
Communication dans un congrès
VISIGRAPP, the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP 2018), Jan 2018, Funchal, Portugal. SCITEPRESS - Science and Technology Publications, 2018, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications 〈10.5220/0006637705960602〉
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01663686
Contributeur : Sylvain Huet <>
Soumis le : jeudi 1 mars 2018 - 09:00:01
Dernière modification le : mardi 10 juillet 2018 - 01:18:30
Document(s) archivé(s) le : mercredi 30 mai 2018 - 12:41:02

Fichier

VISAPP_2018_161.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

Citation

Aziliz Guezou-Philippe, Sylvain Huet, Denis Pellerin, Christian Graff. Prototyping and Evaluating Sensory Substitution Devices by Spatial Immersion in Virtual Environments. VISIGRAPP, the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP 2018), Jan 2018, Funchal, Portugal. SCITEPRESS - Science and Technology Publications, 2018, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications 〈10.5220/0006637705960602〉. 〈hal-01663686〉

Partager

Métriques

Consultations de la notice

409

Téléchargements de fichiers

62