Real-Time Augmented Reality for Ear Surgery

Raabid Hussain (1) , Alain Lalande (2) , Roberto Marroquin (2) , Kibrom Berihu Girum (3) , Caroline Guigou (2) , Alexis Bozorg Grayeli (3)

1 ImViA - Imagerie et Vision Artificielle [Dijon]
2 Le2i - Laboratoire Electronique, Informatique et Image [UMR6306]
3 Le2i - Laboratoire d'Electronique, d'Informatique et d'Image [EA 7508]

Transtympanic procedures aim at accessing the middle ear structures through a puncture in the tympanic membrane. They require visualization of middle ear structures behind the eardrum. Up to now, this is provided by an oto endoscope. This work focused on implementing a real-time augmented reality based system for robotic-assisted transtympanic surgery. A preoperative computed tomography scan is combined with the surgical video of the tympanic membrane in order to visualize the ossciles and labyrinthine windows which are concealed behind the opaque tympanic membrane. The study was conducted on 5 artificial and 4 cadaveric temporal bones. Initially, a homography framework based on fiducials (6 stainless steel markers on the periphery of the tympanic membrane) was used to register a 3D reconstructed computed tomography image to the video images. Micro/endoscope movements were then tracked using Speeded-Up Robust Features. Simultaneously , a micro-surgical instrument (needle) in the frame was identified and tracked using a Kalman filter. Its 3D pose was also computed using a 3-collinear-point framework. An average initial registration accuracy of 0.21 mm was achieved with a slow propagation error during the 2-minute tracking. Similarly, a mean surgical instrument tip 3D pose estimation error of 0.33 mm was observed. This system is a crucial first step towards keyhole surgical approach to middle and inner ears.

Mots clés: Augmented reality; transtympanic procedures; otology; min- imally invasive; image-guided surgery

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Imagerie médicale

Raabid Hussain, Alain Lalande, Roberto Marroquin, Kibrom Berihu Girum, Caroline Guigou, et al.. Real-Time Augmented Reality for Ear Surgery. MICCAI 2018: Medical Image Computing and Computer Assisted Intervention, Sep 2018, Granada, Spain. pp.324-331, ⟨10.1007/978-3-030-00937-3_38⟩. ⟨hal-02308091⟩