2D/3D Real-Time Tracking of Surgical Instruments Based on Endoscopic Image Processing

Anthony Agustinos (1) , Sandrine Voros (2, 1)

1 TIMC-IMAG-GMCAO - Gestes Medico-chirurgicaux Assistés par Ordinateur
2 INSERM - Institut National de la Santé et de la Recherche Médicale

This paper describes a simple and robust algorithm which permits to track surgical instruments without artificial markers in endoscopic images. Based on image processing, this algorithm can estimate the 2D/3D pose of all the instruments visible in the image, in real-time (30 Hz). The originality of the approach is based on the use of a Frangi filter for detecting edges and the tip of instruments. The accuracy of the instruments’ location in the image is evaluated using an extensive dataset (1500 images, 3 laparoscopic surgeries). Pose estimation of instruments in space is quantitatively evaluated on a test bench through comparison with the ground truth positioning provided by a calibrated robotic instrument holder. This method opens perspectives in the real-time control of surgical robots and the intra-operative recognition of surgical gestures.

Mots clés: Laparoscopy; Image processing; Surgical instrument; Real-time tracking

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Imagerie médicale

Anthony Agustinos, Sandrine Voros. 2D/3D Real-Time Tracking of Surgical Instruments Based on Endoscopic Image Processing. Computer-Assisted and Robotic Endoscopy (CARE), Held in Conjunction with MICCAI 2015, Oct 2015, Munich, Germany. pp.90-100, ⟨10.1007/978-3-319-29965-5_9⟩. ⟨hal-01424280⟩