A Direct Dense Visual Servoing Approach using Photometric Moments

Manikandan Bakthavatchalam (1) , Omar Tahri (2) , François Chaumette (1)

1 RAINBOW - Sensor-based and interactive robotics
2 INSA CVL - Institut National des Sciences Appliquées - Centre Val de Loire

In this paper, visual servoing based on photometric moments is advocated. A direct approach is chosen by which the extraction of geometric primitives, visual tracking and image matching steps of a conventional visual servoing pipeline can be bypassed. A vital challenge in photometric methods is the change in the image resulting from the appearance and disappearance of portions of the scene from the camera field of view during the servo. To tackle this issue, a general model for the photometric moments enhanced with spatial weighting is proposed. The interaction matrix for these spatially weighted photometric moments is derived in analytical form. The correctness of the modelling, effectiveness of the proposed strategy in handling the exogenous regions and improved convergence domain are demonstrated with a combination of simulation and experimental results.

Mots clés: photometric moments; image moments; intensity-based visual servoing; dense visual servoing

Domaines: Robotique [cs.RO]

Manikandan Bakthavatchalam, Omar Tahri, François Chaumette. A Direct Dense Visual Servoing Approach using Photometric Moments. IEEE Transactions on Robotics, 2018, 34 (5), pp.1226-1239. ⟨10.1109/TRO.2018.2830379⟩. ⟨hal-01758205⟩