# Convex optimization over intersection of simple sets: improved convergence rate guarantees via an exact penalty approach

2 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique de l'École normale supérieure, CNRS - Centre National de la Recherche Scientifique, Inria de Paris
Abstract : We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty lies in finding the projection of a point in the intersection of many sets. Existing approaches yield an infeasible point with an iteration-complexity of $O(1/\varepsilon^2)$ for nonsmooth problems with no guarantees on the in-feasibility. By reformulating the problem through exact penalty functions, we derive first-order algorithms which not only guarantees that the distance to the intersection is small but also improve the complexity to $O(1/\varepsilon)$ and $O(1/\sqrt{\varepsilon})$ for smooth functions. For composite and smooth problems, this is achieved through a saddle-point reformulation where the proximal operators required by the primal-dual algorithms can be computed in closed form. We illustrate the benefits of our approach on a graph transduction problem and on graph matching.
Type de document :
Communication dans un congrès
AISTATS 2018 - 22nd International Conference on Artificial Intelligence and Statistics, Apr 2018, Canary Islands, Spain. 〈10.06465〉
Domaine :
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01652149
Contributeur : Francis Bach <>
Soumis le : jeudi 30 novembre 2017 - 07:55:35
Dernière modification le : mercredi 30 janvier 2019 - 11:07:48

### Citation

Achintya Kundu, Francis Bach, Chiranjib Bhattacharyya. Convex optimization over intersection of simple sets: improved convergence rate guarantees via an exact penalty approach. AISTATS 2018 - 22nd International Conference on Artificial Intelligence and Statistics, Apr 2018, Canary Islands, Spain. 〈10.06465〉. 〈hal-01652149〉

### Métriques

Consultations de la notice