Seeing without sight : an automatic cognition system dedicated to blind and visually impaired people

Abstract : In this paper we present an automatic cognition system, based on computer vision algorithms and deep convolutional neural networks, designed to assist the visually impaired (VI) users during navigation in highly dynamic urban scenes. A first feature concerns the realtime detection of various types of objects existent in the outdoor environment relevant from the perspective of a VI person. The objects are followed between successive frames using a novel tracker, which exploits an offline trained neural-network and is able to track generic objects using motion patterns and visual attention models. The system is able to handle occlusions, sudden camera/object movements, rotation or various complex changes. Finally, an object classification module is proposed that exploits the YOLO algorithm and extends it with new categories specific to assistive devices applications. The feedback to VI users is transmitted as a set of acoustic warning messages through bone conducting headphones. The experimental evaluation, performed on the VOT 2016 dataset and on a set of videos acquired with the help of VI users, demonstrates the effectiveness and efficiency of the proposed method
Type de document :
Communication dans un congrès
ICCV 2017 : International Conference on Computer Vision, Oct 2017, Venise Italy. The Computer vision foundation, Proceedings ICCV 2017 : International Conference on Computer Vision, pp.1452 - 1459, 2017
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01687512
Contributeur : Médiathèque Télécom Sudparis & Institut Mines-Télécom Business School <>
Soumis le : jeudi 18 janvier 2018 - 15:12:04
Dernière modification le : jeudi 31 mai 2018 - 09:12:02

Identifiants

  • HAL Id : hal-01687512, version 1

Citation

Bogdan Mocanu, Ruxandra Tapu, Titus Zaharia. Seeing without sight : an automatic cognition system dedicated to blind and visually impaired people. ICCV 2017 : International Conference on Computer Vision, Oct 2017, Venise Italy. The Computer vision foundation, Proceedings ICCV 2017 : International Conference on Computer Vision, pp.1452 - 1459, 2017. 〈hal-01687512〉

Partager

Métriques

Consultations de la notice

80