Silhouette-based Pose Estimation for Deformable Organs Application to Surgical Augmented Reality

Abstract : — In this paper we introduce a method for semi-automatic registration of 3D deformable models using 2D shape outlines (silhouettes) extracted from a monocular camera view. Our framework is based on the combination of a biomechanical model of the organ with a set of projective constraints influencing the deformation of the model. To enforce convergence towards a global minimum for this ill-posed problem we interactively provide a rough (rigid) estimation of the pose. We show that our approach allows for the estimation of the non-rigid 3D pose while relying only on 2D information. The method is evaluated experimentally on a soft silicone gel model of a liver, as well as on real surgical data, providing augmented reality of the liver and the kidney using a monocular laparoscopic camera. Results show that the final elastic registration can be obtained in just a few seconds, thus remaining compatible with clinical constraints. We also evaluate the sensitivity of our approach according to both the initial alignment of the model and the silhouette length and shape.
Type de document :
Communication dans un congrès
IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Sep 2017, Vancouver, Canada. 2017
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01578815
Contributeur : Yinoussa Adagolodjo <>
Soumis le : mardi 29 août 2017 - 18:02:32
Dernière modification le : mardi 6 février 2018 - 13:28:06

Fichiers

Iros2017(1).pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01578815, version 1

Collections

Citation

Yinoussa Adagolodjo, Raffaella Trivisonne, Nazim Haouchine, Stéphane Cotin, Hadrien Courtecuisse. Silhouette-based Pose Estimation for Deformable Organs Application to Surgical Augmented Reality. IROS 2017 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Sep 2017, Vancouver, Canada. 2017. 〈hal-01578815〉

Partager

Métriques

Consultations de la notice

333

Téléchargements de fichiers

246