Sensor fusion for interactive real-scale modeling and simulation systems

Abstract : This paper proposes an accurate sensor fusion scheme for navigation inside a real-scale 3D model by combining audio and video signals. Audio signal of a microphone-array is merged by Minimum Variance Distortion-less Response (MVDR) algorithm and processed instantaneously via Hidden Markov Model (HMM) to generate translation commands by word-to-action module of speech processing system. Then, the output of optical head tracker (four IR cameras) is analyzed by non-linear/non-Gaussian Bayesian algorithm to provide information about the orientation of the user's head. The orientation is used to redirect the user toward a new direction by applying quaternion rotation. The output of these two sensors (video and audio) is combined under the sensor fusion scheme to perform continuous travelling inside the model. The maximum precision for the traveling task is achieved under sensor fusion scheme. Practical experiment shows promising results for the implementation.
Type de document :
Communication dans un congrès
18th International Conference on Computer Games (CGAMES USA), Jul 2013, United States. IEEE, pp.149-153, 2013
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00879739
Contributeur : Compte de Service Administrateur Ensam <>
Soumis le : lundi 4 novembre 2013 - 16:55:34
Dernière modification le : mardi 10 octobre 2017 - 13:49:46
Document(s) archivé(s) le : vendredi 7 avril 2017 - 20:46:15

Fichier

LE2I_CGAMES_2013_MIRZAEI.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00879739, version 1
  • ENSAM : http://hdl.handle.net/10985/7455

Collections

Citation

Mohammad Ali Mirzaei, Jean-Rémy Chardonnet, Christian Pere, Frédéric Merienne. Sensor fusion for interactive real-scale modeling and simulation systems. 18th International Conference on Computer Games (CGAMES USA), Jul 2013, United States. IEEE, pp.149-153, 2013. 〈hal-00879739〉

Partager

Métriques

Consultations de
la notice

168

Téléchargements du document

229