Convergence rate analysis of nonquadratic proximal methods for convex and linear programming

Convergence rate analysis of nonquadratic proximal methods for convex and linear programming

0.00 Avg rating0 Votes
Article ID: iaor20041819
Country: United States
Volume: 20
Issue: 3
Start Page Number: 657
End Page Number: 677
Publication Date: Aug 1995
Journal: Mathematics of Operations Research
Authors: ,
Keywords: programming: convex
Abstract:

The phi-divergence proximal method is an extension of the proximal minimization algorithm, where the usual quadratic proximal term is substituted by a class of convex statistical distances, called phi-divergences. In this paper, we study the convergence rate of this nonquadratic proximal method for convex and particularly linear programming. We identify a class of phi-divergences for which superlinear convergence is attained both for optimization problems with strongly convex objectives at the optimum and linear programming problems, when the regularization parameters tend to zero. We prove also that, with regularization parameters bounded away from zero, convergence is at least linear for a wider class of phi-divergences, when the method is applied to the same kinds of problems. We further analyze the associated class of augmented Lagrangian methods for convex programming with nonquadratic penalty terms, and prove convergence of the dual generated by these methods for linear programming problems under a weak nondegeneracy assumption.

Reviews

Required fields are marked *. Your email address will not be published.