TY - JOUR
T1 - Non-euclidean proximal methods for convex-concave saddle-point problems
AU - Cohen, Eyal
AU - Sabach, Shoham
AU - Teboulle, Marc
N1 - Publisher Copyright:
© 2021 Journal of Applied and Numerical Optimization.
PY - 2021/4
Y1 - 2021/4
N2 - Motivated by the flexibility of the Proximal Alternating Predictor Corrector (PAPC) algorithm which can tackle a broad class of structured constrained convex optimization problems via their convex-concave saddle-point reformulation, in this paper, we extend the scope of the PAPC algorithm to include non-Euclidean proximal steps. This allows for adapting to the geometry of the problem at hand to produce simpler computational steps. We prove a sublinear convergence rate of the produced ergodic sequence, and under additional natural assumptions on the non-Euclidean distances, we also prove that the algorithm globally converges to a saddle-point. We demonstrate the performance and simplicity of the proposed algorithm through its application to the multinomial logistic regression problem.
AB - Motivated by the flexibility of the Proximal Alternating Predictor Corrector (PAPC) algorithm which can tackle a broad class of structured constrained convex optimization problems via their convex-concave saddle-point reformulation, in this paper, we extend the scope of the PAPC algorithm to include non-Euclidean proximal steps. This allows for adapting to the geometry of the problem at hand to produce simpler computational steps. We prove a sublinear convergence rate of the produced ergodic sequence, and under additional natural assumptions on the non-Euclidean distances, we also prove that the algorithm globally converges to a saddle-point. We demonstrate the performance and simplicity of the proposed algorithm through its application to the multinomial logistic regression problem.
KW - Bregman and ϕ-divergences
KW - Convergence rate
KW - Iteration complexity
KW - Non-Euclidean proximal distances and algorithms
KW - Nonsmooth convex minimization
KW - Saddle-point problems
UR - http://www.scopus.com/inward/record.url?scp=85104980651&partnerID=8YFLogxK
U2 - 10.23952/jano.3.2021.1.04
DO - 10.23952/jano.3.2021.1.04
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85104980651
SN - 2562-5527
VL - 3
SP - 43
EP - 60
JO - Journal of Applied and Numerical Optimization
JF - Journal of Applied and Numerical Optimization
IS - 1
ER -