Higher order curvature information and its application in a modified diagonal Secant method

A secant equation (quasi-Newton) has one of the most important rule to find an optimal solution in nonlinear optimization. Curvature information must satisfy the usual secant equation to ensure positive definiteness of the Hessian approximation. In this work, we present a new diagonal updating to im...

Full description

Bibliographic Details
Main Authors: Enshaei, Sharareh, Farid, Mahboubeh, Wah, June Leong, Ardestani, S. Mohsen Hashemi
Format: Article
Language:English
Published: Taylor & Francis 2018
Online Access:http://psasir.upm.edu.my/id/eprint/74506/1/Higher%20order.pdf
Description
Summary:A secant equation (quasi-Newton) has one of the most important rule to find an optimal solution in nonlinear optimization. Curvature information must satisfy the usual secant equation to ensure positive definiteness of the Hessian approximation. In this work, we present a new diagonal updating to improve the Hessian approximation with a modifying weak secant equation for the diagonal quasi-Newton (DQN) method. The gradient and function evaluation are utilized to obtain a new weak secant equation and achieve a higher order accuracy in curvature information in the proposed method. Modified DQN methods based on the modified weak secant equation are globally convergent. Extended numerical results indicate the advantages of modified DQN methods over the usual ones and some classical conjugate gradient methods.