Global Robot Ego-localization Combining Image Retrieval and HMM-based Filtering

Cédric Le Barz (1) , Nicolas Thome (2) , Matthieu Cord (2) , Stéphane Herbin (3) , Martial Sanfourche (3)

1 Thales Services
2 MLIA - Machine Learning and Information Access
3 ONERA - The French Aerospace Lab [Palaiseau]

This paper addresses the problem of global visual ego-localization of a robot equipped with a monocular camera that has to navigate autonomously in an urban environment. The robot has access to a database of geo-referenced images of its environment and to the outputs of an odometric system (Inertial Measurement Unit or visual odometry). We suppose that no GPS information is available. The goal of the approach described and evaluated in this paper is to exploit a Hidden Markov Model (HMM) to combine the localization estimates provided by the odometric system and the visual similarities between acquired images and the geo-localized image database. It is shown that the use of spatial and temporal constraints reduces the mean localization error from 16 m to 4 m over a 11 km path evaluated on the Google Pittsburgh dataset when compared to an image based method alone.

Mots clés: Image retrieval; Autonomous navigation; UGV; UAV

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Cédric Le Barz, Nicolas Thome, Matthieu Cord, Stéphane Herbin, Martial Sanfourche. Global Robot Ego-localization Combining Image Retrieval and HMM-based Filtering. 6th Workshop on Planning, Perception and Navigation for Intelligent Vehicles, Sep 2014, Chicago, United States. 6 p. ⟨hal-01069869⟩