Skip to Main content Skip to Navigation
Journal articles

Using Curvilinear Features in Focus for Registering a Single Image to a 3D Object

Abstract : In the context of 2D/3D registration, this paper introduces an approach that allows for matching features detected in two different modalities, photographs, and 3D models, by using a common 2D representation. More precisely, 2D images are matched with a set of depth images representing the 3D model. After introducing the concept of Curvilinear Saliency, which is related to curvature estimation, we propose a new ridge and valley detector for depth images rendered from 3D models. A variant of this detector is adapted to photographs, first by considering multi-scale features and second by integrating the focus curve principle. Finally, a registration algorithm determines the correct view of the 3D model and, thus, the pose of the photograph. This approach relies on the Histogram of Curvilinear Saliency (HCS), an adaptation of the Histogram of Oriented Gradients (HOG) to the proposed features in 2D and 3D. The presented results highlight both the quality of the features detected in terms of repeatability and the interest of the approach for registration and pose estimation.
Document type :
Journal articles
Complete list of metadata

Cited literature [50 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02891651
Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Tuesday, July 7, 2020 - 9:17:12 AM
Last modification on : Wednesday, June 9, 2021 - 10:00:35 AM
Long-term archiving on: : Friday, November 27, 2020 - 12:12:08 PM

File

Rashwan_26179.pdf
Files produced by the author(s)

Identifiers

Citation

Hatem A. Rashwan, Sylvie Chambon, Pierre Gurdjos, Géraldine Morin, Vincent Charvillat. Using Curvilinear Features in Focus for Registering a Single Image to a 3D Object. IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2019, 28 (9), pp.4429- 4443. ⟨10.1109/TIP.2019.2911484⟩. ⟨hal-02891651⟩

Share

Metrics

Record views

37

Files downloads

111