Robust Augmented Reality registration method for Localization of Solid Organs’ Tumors Using CT-derived Virtual Biomechanical Model and Fluorescent Fiducials

Seong-Ho Kong (1) , Nazim Haouchine (2, 3) , Renato Soares (3) , Bruno Marques (2) , Michele Diana (3) , Galyna Shabat (4) , Bohdan Andreiuk (5) , Andrey S Klymchenko (5) , Thierry Piéchaud (6) , Stéphane Cotin (2) , Jacques Marescaux (4)

1 Seoul National University Hospital
2 MIMESIS - Computational Anatomy and Simulation for Medicine
3 IHU Strasbourg - L'Institut hospitalo-universitaire de Strasbourg
4 IRCAD/EITS - Institut de Recherche Contre les Cancers de l'Appareil Digestif-European Institute of Telesurgery
5 PPCICM - Pharmacologie et physico-chimie des interactions cellulaires et moléculaires
6 Clinique Saint Augustin

Accurate localization of solid organs tumors is crucial to ensure both radicality and organ function preservation. Augmented Reality (AR) is the fusion of computer-generated and real-time images. AR can be used in surgery as a navigation tool, by creating a patient-specific virtual model through 3D software manipulation of DICOM imaging (e.g. CT-scan). The virtual model can be superimposed to the real-time images to obtain the enhanced real-time localization. However, the 3D virtual model is rigid, and does not take into account inner structures’ deformations. We present a concept of automated navigation system, enabling transparency visualization of internal anatomy and tumor’s margins, while the organs undergo deformation during breathing or surgical manipulation.

Domaines: Informatique [cs]; Sciences du Vivant [q-bio]

Seong-Ho Kong, Nazim Haouchine, Renato Soares, Bruno Marques, Michele Diana, et al.. Robust Augmented Reality registration method for Localization of Solid Organs’ Tumors Using CT-derived Virtual Biomechanical Model and Fluorescent Fiducials. Society of American Gastrointestinal and Endoscopic Surgeons - Annual Meeting - Emerging Technology, Mar 2016, Boston, United States. ⟨hal-01314963v1⟩