Deformable image registration with deep network priors: a study on longitudinal PET images

Constance Fourcade (1, 2, 3) , Ludovic Ferrer (4, 5) , Noémie Moreau (2) , Gianmarco Santini (2) , Aislinn Brennan (2) , Caroline Rousseau (4, 5) , Marie Lacombe (4, 5) , Vincent Fleury (4) , Mathilde Colombié (4) , Pascal Jézéquel (4, 5) , Mathieu Rubeaux (2) , Diana Mateus (3)

1 Nantes Univ - ECN - École Centrale de Nantes
2 Keosys
3 LS2N - Laboratoire des Sciences du Numérique de Nantes
4 UNICANCER/ICO - Institut de Cancérologie de l'Ouest [Angers/Nantes]
5 CRCI2NA - Centre de Recherche en Cancérologie et Immunologie Intégrée Nantes-Angers

Objective. This paper proposes a novel approach for the longitudinal registration of PET imaging acquired for the monitoring of patients with metastatic breast cancer. Unlike with other image analysis tasks, the use of deep learning (DL) has not significantly improved the performance of image registration. With this work, we propose a new registration approach to bridge the performance gap between conventional and DL-based methods: medical image registration method regularized by architecture ( MIRRBA ). Approach. MIRRBA is a subject-specific deformable registration method which relies on a deep pyramidal architecture to parametrize the deformation field. Diverging from the usual deep-learning paradigms, MIRRBA does not require a learning database, but only a pair of images to be registered that is used to optimize the network's parameters. We applied MIRRBA on a private dataset of 110 whole-body PET images of patients with metastatic breast cancer. We used different architecture configurations to produce the deformation field and studied the results obtained. We also compared our method to several standard registration approaches: two conventional iterative registration methods (ANTs and Elastix) and two supervised DL-based models (LapIRN and Voxelmorph). Registration accuracy was evaluated using the Dice score, the target registration error, the average Hausdorff distance and the detection rate, while the realism of the registration obtained was evaluated using Jacobian's determinant. The ability of the different methods to shrink disappearing lesions was also computed with the disappearing rate. Main results. MIRRBA significantly improved all metrics when compared to DL-based approaches. The organ and lesion Dice scores of Voxelmorph improved by 6% and 52% respectively, while the ones of LapIRN increased by 5% and 65%. Regarding conventional approaches, MIRRBA presented comparable results showing the feasibility of our method. Significance. In this paper, we also demonstrate the regularizing power of deep architectures and present new elements to understand the role of the architecture in DL methods used for registration.

Mots clés: Image registration; PET; Brest cancer; Deep Image Prior

Domaines: Intelligence artificielle [cs.AI]

Constance Fourcade, Ludovic Ferrer, Noémie Moreau, Gianmarco Santini, Aislinn Brennan, et al.. Deformable image registration with deep network priors: a study on longitudinal PET images. Physics in Medicine and Biology, 2022, 67 (15), pp.155011. ⟨10.1088/1361-6560/ac7e17⟩. ⟨hal-03584128v2⟩