Skip to Main content Skip to Navigation
Conference papers

Theoretical Analysis of Domain Adaptation with Optimal Transport

Ievgen Redko 1 Amaury Habrard 2 Marc Sebban 2
1 Images et Modèles
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
Abstract : Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. This kind of learning paradigm is of vital importance for future advances as it allows a learner to generalize the knowledge across different tasks. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of minimizing the divergence between source and target probability distributions. In this paper, we provide a theoretical study on the advantages that concepts borrowed from optimal transportation theory [17] can bring to DA. In particular, we show that the Wasserstein metric can be used as a divergence measure between distributions to obtain generalization guarantees for three different learning settings: (i) classic DA with unsupervised target data (ii) DA combining source and target labeled data, (iii) multiple source DA. Based on the obtained results, we motivate the use of the regularized optimal transport and provide some algorithmic insights for multi-source domain adaptation. We also show when this theoretical analysis can lead to tighter inequalities than those of other existing frameworks. We believe that these results open the door to novel ideas and directions for DA.
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01613564
Contributor : Marc Sebban <>
Submitted on : Monday, October 9, 2017 - 5:42:58 PM
Last modification on : Monday, January 13, 2020 - 5:46:06 PM
Document(s) archivé(s) le : Wednesday, January 10, 2018 - 3:04:08 PM

File

paperID194.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01613564, version 1

Citation

Ievgen Redko, Amaury Habrard, Marc Sebban. Theoretical Analysis of Domain Adaptation with Optimal Transport. ECML PKDD 2017, Sep 2017, Skopje, Macedonia. ⟨hal-01613564⟩

Share

Metrics

Record views

411

Files downloads

354