CNN-assisted coverings in the space of tilts: best affine invariant performances with the speed of CNNs - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

CNN-assisted coverings in the space of tilts: best affine invariant performances with the speed of CNNs

Mariano Rodríguez
Gabriele Facciolo
  • Fonction : Auteur
  • PersonId : 973682
Rafael Grompone von Gioi
  • Fonction : Auteur
  • PersonId : 914703
Julie Delon
Jean-Michel Morel
  • Fonction : Auteur
  • PersonId : 863347

Résumé

The classic approach to image matching consists in the detection, description and matching of keypoints. In the description, the local information surrounding the keypoint is encoded. This locality enables affine invariant methods. Indeed, smooth deformations caused by viewpoint changes are well approximated by affine maps. Despite numerous efforts, affine invariant descriptors have remained elusive. This has led to the development of IMAS (Image Matching by Affine Simulation) methods that simulate viewpoint changes to attain the desired invariance. Yet, recent CNN-based methods seem to provide a way to learn affine invariant descriptors. Still, as a first contribution, we show that current CNN-based methods are far from the state-of-the-art performance provided by IMAS. This confirms that there is still room for improvement for learned methods. Second, we show that recent advances in affine patch nor-malization can be used to create adaptive IMAS methods that select their affine simulations depending on query and target images. The proposed methods are shown to attain a good compromise: on the one hand, they reach the performance of state-of-the-art IMAS methods but are faster; on the other hand, they perform significantly better than non-simulating methods, including recent ones. Source codes are available at https://rdguez-mariano.github.io/pages/adimas.
Fichier principal
Vignette du fichier
main.pdf (3 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02494121 , version 1 (28-02-2020)

Identifiants

Citer

Mariano Rodríguez, Gabriele Facciolo, Rafael Grompone von Gioi, Pablo Muse, Julie Delon, et al.. CNN-assisted coverings in the space of tilts: best affine invariant performances with the speed of CNNs. 2020 IEEE International Conference on Image Processing (ICIP), Oct 2020, Abu Dhabi, United Arab Emirates. ⟨10.1109/ICIP40778.2020.9191245⟩. ⟨hal-02494121⟩
66 Consultations
120 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More