Accès à de l'information en mobilité par l'image pour la visite de Musées Réseaux profonds pour l'identification de gestes et d'objets

Maxime Portaz 1
1 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
LIG - Laboratoire d'Informatique de Grenoble, Inria - Institut National de Recherche en Informatique et en Automatique
Abstract : This thesis is part of the GUIMUTEIC project, which aim is to equip museum tourist with an audio-guide enhanced by a camera.Thisthesis adressthe problem of information access in mobile environment, by automaticaly providing information about museum artefacts. To be able to give this information, we need to know when the visitor desire guidance, and what he is looking at, to give the correct response. This raises issues of identification of points of interest, to determine the context, and identification of user gestures, to meet his demands. As part of our project, the visitor is equipped with an embedded camera.The goal isto provide a solutionto help withthe visit, developing vision methods for object identification, and gesture detection in first-person videos. We propose in this thesis a study of the feasibility and the interest of the assistance to the visit, as well as the relevance of the gestures in the context of the interaction with an embedded system.We propose a new approach for objects identificationthanksto siamese neural networks to learn images similarity and define regions of interest. We are also exploring the use of small networks for gesture recognition in mobility. We present for this an architecture using new types of convolution blocks, to reduce the number of parameters of the network and allow its use on mobile processor. To evaluate our proposals, we rely on several corpus of image search and gestures, specificaly designed to match the constraints of the project.
Document type :
Theses
Complete list of metadatas

Cited literature [140 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/tel-01955183
Contributor : Philippe Mulhem <>
Submitted on : Friday, December 14, 2018 - 2:59:49 PM
Last modification on : Friday, October 25, 2019 - 1:29:41 AM
Long-term archiving on: Friday, March 15, 2019 - 2:28:21 PM

Identifiers

  • HAL Id : tel-01955183, version 1

Collections

Citation

Maxime Portaz. Accès à de l'information en mobilité par l'image pour la visite de Musées Réseaux profonds pour l'identification de gestes et d'objets. Recherche d'information [cs.IR]. Université Grenoble Alpes, 2018. Français. ⟨tel-01955183⟩

Share

Metrics

Record views

111

Files downloads

65