Article ID: | iaor20124800 |
Volume: | 154 |
Issue: | 3 |
Start Page Number: | 916 |
End Page Number: | 932 |
Publication Date: | Sep 2012 |
Journal: | Journal of Optimization Theory and Applications |
Authors: | Babaie-Kafaki Saman |
Keywords: | incremental gradient algorithms |
In order to take advantage of the attractive features of Polak–Ribière–Polyak and Fletcher–Reeves conjugate gradient methods, two hybridizations of these methods are suggested, using a quadratic relaxation of a hybrid conjugate gradient parameter proposed by Gilbert and Nocedal. In the suggested methods, the hybridization parameter is computed based on a conjugacy condition. Under proper conditions, it is shown that the proposed methods are globally convergent for general objective functions. Numerical results are reported; they demonstrate the efficiency of one of the proposed methods in the sense of the performance profile introduced by Dolan and Moré.