A sequential ascending parameter method for solving constrained minimization problems

Amir Beck*, Aharon Ben-Tal, Luba Tetruashvili

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper, a method for solving constrained convex optimization problems is introduced. The problem is cast equivalently as a parametric unconstrained one, the (single) parameter being the optimal value of the original problem. At each stage of the algorithm the parameter is updated, and the resulting subproblem is only approximately solved. A linear rate of convergence of the parameter sequence is established. Using an optimal gradient method due to Nesterov [Dokl. Akad. Nauk SSSR, 269 (1983), pp. 543-547] to solve the arising subproblems, it is proved that the resulting gradient-based algorithm requires an overall of O(log(1/e)/√e) inner iterations to obtain an e-optimal and feasible solution. An image deblurring problem is solved, demonstrating the capability of the algorithm to solve large-scale problems within reasonable accuracy.

Original languageEnglish
Pages (from-to)244-260
Number of pages17
JournalSIAM Journal on Optimization
Volume22
Issue number1
DOIs
StatePublished - 2012
Externally publishedYes

Keywords

  • Convex optimization
  • Image deblurring
  • Linear rate of convergence
  • Optimal gradient methods

Fingerprint

Dive into the research topics of 'A sequential ascending parameter method for solving constrained minimization problems'. Together they form a unique fingerprint.

Cite this