Homography-based Riccati observer design for camera pose estimation

Tarek Bouazza (1, 2) , Tarek Hamel (1, 2, 3) , Minh Duc Hua (1, 2, 1) , Robert Mahony (4)

1 I3S - Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis
2 Laboratoire I3S - SIS - Signal, Images et Systèmes
3 IUF - Institut universitaire de France
4 ANU - Australian National University - Department of engineering

This paper introduces a novel approach for estimating the relative pose of a mobile robot equipped with an onboard IMU, a velocity sensor complemented with a monocular camera observing a planar scene. The proposed solution relies on the design of a deterministic Riccati observer that exploits the first-order approximations of a class of nonlinear systems. It uses the point-feature correspondences of a sequence of images and exploits the homography constraint to derive the system's measurement equation. The observability analysis, which highlights the uniform observability condition under which local exponential stability is guaranteed, is performed. Moreover, an extension of the observer to depth estimation is provided. Finally, the proposed observer solution is validated through simulation and experimental results.

Domaines: Automatique; Vision par ordinateur et reconnaissance de formes [cs.CV]; Robotique [cs.RO]; Systèmes dynamiques [math.DS]

Tarek Bouazza, Tarek Hamel, Minh Duc Hua, Robert Mahony. Homography-based Riccati observer design for camera pose estimation. 61st IEEE Conference on Decision and Control, 2022, Cancun, Mexico. ⟨hal-03851200⟩