Theoretical Analysis of Domain Adaptation with Optimal Transport

Ievgen Redko 1 Amaury Habrard 2 Marc Sebban 2
1 Images et Modèles
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
Abstract : Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. This kind of learning paradigm is of vital importance for future advances as it allows a learner to generalize the knowledge across different tasks. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of minimizing the divergence between source and target probability distributions. In this paper, we provide a theoretical study on the advantages that concepts borrowed from optimal transportation theory [17] can bring to DA. In particular, we show that the Wasserstein metric can be used as a divergence measure between distributions to obtain generalization guarantees for three different learning settings: (i) classic DA with unsupervised target data (ii) DA combining source and target labeled data, (iii) multiple source DA. Based on the obtained results, we motivate the use of the regularized optimal transport and provide some algorithmic insights for multi-source domain adaptation. We also show when this theoretical analysis can lead to tighter inequalities than those of other existing frameworks. We believe that these results open the door to novel ideas and directions for DA.
Type de document :
Communication dans un congrès
ECML PKDD 2017, Sep 2017, Skopje, Macedonia
Liste complète des métadonnées

Littérature citée [28 références]  Voir  Masquer  Télécharger
Contributeur : Marc Sebban <>
Soumis le : lundi 9 octobre 2017 - 17:42:58
Dernière modification le : samedi 27 octobre 2018 - 01:27:29
Document(s) archivé(s) le : mercredi 10 janvier 2018 - 15:04:08


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01613564, version 1


Ievgen Redko, Amaury Habrard, Marc Sebban. Theoretical Analysis of Domain Adaptation with Optimal Transport. ECML PKDD 2017, Sep 2017, Skopje, Macedonia. 〈hal-01613564〉



Consultations de la notice


Téléchargements de fichiers