A New PAC-Bayesian View of Domain Adaptation

Pascal Germain (1) , François Laviolette (1) , Amaury Habrard (2) , Emilie Morvant (2)

1 Department of Computer Science and Software Engineering [Québec]
2 LHC - Laboratoire Hubert Curien

We propose a new theoretical study of domain adaptation for majority vote classifiers (from a source to a target domain). We upper bound the target risk by a trade-off between only two terms: The voters’ joint errors on the source domain, and the voters’ disagreement on the target one. Hence, this new study is simpler than other analyses that usually rely on three terms. We also derive a PAC-Bayesian generalization bound leading to a DA algorithm for linear classifiers.

Domaines: Machine Learning [stat.ML]

Pascal Germain, François Laviolette, Amaury Habrard, Emilie Morvant. A New PAC-Bayesian View of Domain Adaptation. NIPS 2015 Workshop on Transfer and Multi-Task Learning: Trends and New Perspectives, Dec 2015, Montréal, Canada. ⟨hal-01223164⟩