Wasserstein discriminant analysis |
| |
Authors: | Rémi Flamary Marco Cuturi Nicolas Courty Alain Rakotomamonjy |
| |
Affiliation: | 1.Lagrange, Observatoire de la C?te d’Azur,Université C?te d’Azur,Nice,France;2.CREST, ENSAE, Campus Paris-Saclay,Palaiseau,France;3.Laboratoire IRISA,Campus de Tohannic,Vannes,France;4.LITIS EA4108,Université Rouen Normandie,Saint-Etienne du Rouvray,France |
| |
Abstract: | Wasserstein discriminant analysis (WDA) is a new supervised linear dimensionality reduction algorithm. Following the blueprint of classical Fisher Discriminant Analysis, WDA selects the projection matrix that maximizes the ratio of the dispersion of projected points pertaining to different classes and the dispersion of projected points belonging to a same class. To quantify dispersion, WDA uses regularized Wasserstein distances. Thanks to the underlying principles of optimal transport, WDA is able to capture both global (at distribution scale) and local (at samples’ scale) interactions between classes. In addition, we show that WDA leverages a mechanism that induces neighborhood preservation. Regularized Wasserstein distances can be computed using the Sinkhorn matrix scaling algorithm; the optimization problem of WDA can be tackled using automatic differentiation of Sinkhorn’s fixed-point iterations. Numerical experiments show promising results both in terms of prediction and visualization on toy examples and real datasets such as MNIST and on deep features obtained from a subset of the Caltech dataset. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|