Using inexact gradients in a multilevel optimization algorithm

Using inexact gradients in a multilevel optimization algorithm

0.00 Avg rating0 Votes
Article ID: iaor20133983
Volume: 56
Issue: 1
Start Page Number: 39
End Page Number: 61
Publication Date: Sep 2013
Journal: Computational Optimization and Applications
Authors: ,
Keywords: multi-level programming, gradient search
Abstract:

Many optimization algorithms require gradients of the model functions, but computing accurate gradients can be computationally expensive. We study the implications of using inexact gradients in the context of the multilevel optimization algorithm MG/Opt. MG/Opt recursively uses (typically cheaper) coarse models to obtain search directions for finer‐level models. However, MG/Opt requires the gradient on the fine level to define the recursion. Our primary focus here is the impact of the gradient errors on the multilevel recursion. We analyze, partly through model problems, how MG/Opt is affected under various assumptions about the source of the error in the gradients, and demonstrate that in many cases the effect of the errors is benign. Computational experiments are included.

Reviews

Required fields are marked *. Your email address will not be published.