Automated visibility map of the internal colon surface from colonoscopy video

Armin Mohammad Ali , Girija Chetty (1) , Hans de Visser , Cédric Dumas (2) , Florian Grimpen , Olivier Salvado (3)

1 University of Canberra
2 LUNAM / Ecole des Mines de Nantes / IRCCyN /
3 CSIRO ICT Centre - CSIRO Information and Commuciation Technologies

Purpose Optical colonoscopy is a prominent procedure by which clinicians examine the surface of the colon for cancerous polyps using a flexible colonoscope. One of the main concerns regarding the quality of the colonoscopy is to ensure that the whole colonic surface has been inspected for abnormalities. In this paper, we aim at estimating areas that have not been covered thoroughly by providing a map from the internal colon surface. Methods Camera parameters were estimated using optical flow between consecutive colonoscopy frames. A cylinder model was fitted to the colon structure using 3D pseudo stereo vision and projected into each frame. A circumferential band from the cylinder was extracted to unroll the internal colon surface (band image). By registering these band images, drift in estimating camera motion could be reduced, and a visibility map of the colon surface could be generated, revealing uncovered areas by the colonoscope. Hidden areas behind haustral folds were ignored in this study. The method was validated on simulated and actual colonoscopy videos. The realistic simulated videos were generated using a colonoscopy simulator with known ground truth, and the actual colonoscopy videos were manually assessed by a clinical expert. Results The proposed method obtained a sensitivity and precision of 98 and 96 % for detecting the number of uncovered areas on simulated data, whereas validation on real videos showed a sensitivity and precision of 96 and 78 %, respectively. Error in camera motion drift could be reduced by almost 50 % using results from band image registration. Conclusion Using a simple cylindrical model for the colon and reducing drift by registering band images allows for the generation of visibility maps. The current results also suggest that the provided feedback through the visibility map could enhance clinicians’ awareness of uncovered areas, which in return could reduce the probability of missing polyps.

Mots clés: Colonoscopy quality; Camera motion parameters; Camera motion drift; Optical colonoscopy; Uncovered area; Visibility map

Domaines: Interface homme-machine [cs.HC]

Armin Mohammad Ali, Girija Chetty, Hans de Visser, Cédric Dumas, Florian Grimpen, et al.. Automated visibility map of the internal colon surface from colonoscopy video. International Journal of Computer Assisted Radiology and Surgery, 2016, 11 (9), pp.1599-1610. ⟨10.1007/s11548-016-1462-8⟩. ⟨hal-01495445⟩