Spectral-like conjugate gradient methods with sufficient descent property for vector optimization

PLoS One. 2024 May 15;19(5):e0302441. doi: 10.1371/journal.pone.0302441. eCollection 2024.

Abstract

Several conjugate gradient (CG) parameters resulted in promising methods for optimization problems. However, it turns out that some of these parameters, for example, 'PRP,' 'HS,' and 'DL,' do not guarantee sufficient descent of the search direction. In this work, we introduce new spectral-like CG methods that achieve sufficient descent property independently of any line search (LSE) and for arbitrary nonnegative CG parameters. We establish the global convergence of these methods for four different parameters using Wolfe LSE. Our algorithm achieves this without regular restart and assumption of convexity regarding the objective functions. The sequences generated by our algorithm identify points that satisfy the first-order necessary condition for Pareto optimality. We conduct computational experiments to showcase the implementation and effectiveness of the proposed methods. The proposed spectral-like methods, namely nonnegative SPRP, SHZ, SDL, and SHS, exhibit superior performance based on their arrangement, outperforming HZ and SP methods in terms of the number of iterations, function evaluations, and gradient evaluations.

MeSH terms

  • Algorithms*
  • Computer Simulation

Grants and funding

This research was funded by King Mongkut’s University of Technology North Bangkok, with contract no. KMUTNB-67-KNOW-17.