Metric Learning as Convex Combinations of Local Models with Generalization Guarantees

Abstract : Over the past ten years, metric learning allowed the improvement of numerous machine learning approaches that manipulate distances or similarities. In this field, local metric learning has been shown to be very efficient, especially to take into account non linearities in the data and better capture the peculiarities of the application of interest. However, it is well known that local metric learning (i) can entail overfitting and (ii) face difficulties to compare two instances that are assigned to two different local models. In this paper, we address these two issues by introducing a novel metric learning algorithm that linearly combines local models (C2LM). Starting from a partition of the space in regions and a model (a score function) for each region, C2LM defines a metric between points as a weighted combination of the models. A weight vector is learned for each pair of regions, and a spatial regularization ensures that the weight vectors evolve smoothly and that nearby models are favored in the combination. The proposed approach has the particularity of working in a regression setting, of working implicitly at different scales, and of being generic enough so that it is applicable to similarities and distances. We prove theoretical guarantees of the approach using the framework of algorithmic robustness. We carry out experiments with datasets using both distances (perceptual color distances, using Mahalanobis-like distances) and similarities (semantic word similarities, using bilinear forms), showing that C2LM consistently improves regression accuracy even in the case where the amount of training data is small.
Type de document :
Communication dans un congrès
CVPR2016, Jun 2016, Las Vegas, United States. CVPR 2016 Proceedings
Liste complète des métadonnées

Littérature citée [28 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01323567
Contributeur : Valentina Zantedeschi <>
Soumis le : mercredi 16 novembre 2016 - 11:46:44
Dernière modification le : jeudi 11 janvier 2018 - 06:20:36
Document(s) archivé(s) le : jeudi 16 mars 2017 - 13:20:42

Fichier

c2lm_site.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01323567, version 1

Collections

Citation

Valentina Zantedeschi, Rémi Emonet, Marc Sebban. Metric Learning as Convex Combinations of Local Models with Generalization Guarantees. CVPR2016, Jun 2016, Las Vegas, United States. CVPR 2016 Proceedings. 〈hal-01323567〉

Partager

Métriques

Consultations de la notice

208

Téléchargements de fichiers

26