Wasserstein Discriminant Analysis - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Machine Learning Année : 2018

Wasserstein Discriminant Analysis

Marco Cuturi
Alain Rakotomamonjy

Résumé

Wasserstein Discriminant Analysis (WDA) is a new supervised method that canimprove classification of high-dimensional data by computing a suitable linearmap onto a lower dimensional subspace. Following the blueprint of classical Lin-ear Discriminant Analysis (LDA), WDA selects the projection matrix that maxi-mizes the ratio of two quantities: the dispersion of projected points coming fromdifferent classes, divided by the dispersion of projected points coming from thesame class. To quantify dispersion, WDA uses regularized Wasserstein distances,rather than cross-variance measures which have been usually considered, notablyin LDA. Thanks to the the underlying principles of optimal transport, WDA is ableto capture both global (at distribution scale) and local (at samples scale) interac-tions between classes. Regularized Wasserstein distances can be computed usingthe Sinkhorn matrix scaling algorithm; We show that the optimization of WDAcan be tackled using automatic differentiation of Sinkhorn iterations. Numericalexperiments show promising results both in terms of prediction and visualizationon toy examples and real life datasets such as MNIST and on deep features ob-tained from a subset of the Caltech dataset.
Fichier principal
Vignette du fichier
1608.08063v1.pdf (583.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01377528 , version 1 (07-10-2016)

Identifiants

Citer

Rémi Flamary, Marco Cuturi, Nicolas Courty, Alain Rakotomamonjy. Wasserstein Discriminant Analysis. Machine Learning, 2018, 107 (12), pp.1923-1945. ⟨10.1007/s10994-018-5717-1⟩. ⟨hal-01377528⟩
587 Consultations
548 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More