Article ID: | iaor201110513 |
Volume: | 151 |
Issue: | 2 |
Start Page Number: | 304 |
End Page Number: | 320 |
Publication Date: | Nov 2011 |
Journal: | Journal of Optimization Theory and Applications |
Authors: | Miljkovic Sladjana, Miladinovic Marko, Stanimirovic Predrag |
Keywords: | heuristics, matrices |
We introduce a gradient descent algorithm for solving large scale unconstrained nonlinear optimization problems. The computation of the initial trial steplength is based on the usage of both the quasi‐Newton property and the Hessian inverse approximation by an appropriate scalar matrix. The nonmonotone line search technique for the steplength calculation is applied later. The computational and storage complexity of the new method is equal to the computational and storage complexity of the Barzilai and Borwein method. On the other hand, the reported numerical results indicate improvements in favor of the new method with respect to the well known global Barzilai and Borwein method.