A three-term conjugate gradient method with nonmonotone line search for unconstrained optimization

The technique of nonmontone line search has received much attention in nonlinear optimization. This technique can improve the computational cost of the line search process and increase the rate of convergence of the algorithm. However, the convergence of this line search scheme utilizes some rather...

Full description

Bibliographic Details
Main Authors: Moyi, Aliyu Usman, Leong, Wah June
Format: Article
Language:English
Published: Yokohama Publishers 2016
Online Access:http://psasir.upm.edu.my/id/eprint/54951/1/A%20three-term%20conjugate%20gradient%20method%20with%20nonmonotone%20line%20search%20for%20.pdf
Description
Summary:The technique of nonmontone line search has received much attention in nonlinear optimization. This technique can improve the computational cost of the line search process and increase the rate of convergence of the algorithm. However, the convergence of this line search scheme utilizes some rather restrictive assumption concerning the search directions, which may not hold for most conjugate gradient methods. Thus in this paper, we propose a three-term conjugate gradient method with nonmonotone backtracking line search technique for solving large scale unconstrained optimization problems. Convergence analysis of the proposed method is established under reasonable conditions. Numerical experiments carried out on benchmark test problems has clearly indicated the effectiveness of the developed algorithm in terms of efficiency and robustness.