Abstract
The Hestenes–Stiefel (HS) method is an efficient method for solving large-scale unconstrained optimization problems. In this paper, we extend the HS method to solve constrained nonlinear equations, and propose a modified HS projection method, which combines the modified HS method proposed by Zhang et al. with the projection method developed by Solodov and Svaiter. Under some mild assumptions, we show that the new method is globally convergent with an Armijo line search. Moreover, the R-linear convergence rate of the new method is established. Some preliminary numerical results show that the new method is efficient even for large-scale constrained nonlinear equations.
Similar content being viewed by others
References
Chen, J., Mangasarian, O.L.: A class of smoothing functions for nonlinear and mixed complementarity problems. Comput. Optim. Appl. 5, 97–138 (1996)
Dirkse, S.P., Ferris, M.C.: MCPLIB: A collection of nonlinear mixed complementarity problems. Optim. Methods Softw. 5, 319–345 (1995)
Wood, A.J., Wollenberg, B.F.: Power generation, operation, and control. Wiley, New York (1996)
Tong, X.J., Zhou, S.Z.: A smoothing projected Newton-type method for semismooth equations with bound constraints. J. Industrial. Management. Optim. 1, 235–250 (2005)
Sun, D.F., Womersley, R.S., Qi, H.D.: A feasible semismooth asymptotically Newton method for mixed complementarity problems. Math. Program. 94, 167–187 (2002)
Qi, L.Q., Tong, X.J., Li, D.H.: An active-set projected trust region algorithm for box constrained nonsmooth equations. J. Optim. Theory Appl. 120, 601–625 (2004)
Ulbrich, M.: Nonmonotone trust-region method for bound-constrained semismooth equations with applications to nonlinear complementarity problems. SIAM J. Optim. 11, 889–917 (2001)
Yu, Z.S., Lin, J., Sun, J., Xiao, Y.H., Liu, L.Y., Li, Z.H.: Spectral gradient projection method for monotone nonlinear equations with convex constraints. Appl. Numer. Math. 59, 2416–2423 (2009)
Zhang, L., Zhou, W.J.: Spectral gradient projection method for solving nonlinear monotone equations. J. Comput. Appl. Math. 196, 478–484 (2006)
Liu, S.Y., Huang, Y.Y., Jiao, H.W.: Sufficient descent conjugate gradient methods for solving convex constrained nonlinear monotone equations, Abstract and Applied Analysis, Volume 2014, 12 pages (2014).
Xiao, Y.H., Zhu, H.: A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing. Journal of Mathematical Analysis and Applications 405, 310–319 (2013)
Li, D.H., Wang, X.L.: A modified Fletcher-Reeves-type derivative-free method for symmetric nonlinear equations. Numerical Algebra, Control and Optimization 1, 71–82 (2011)
Sun. M., Liu. J.: Three derivative-free projection methods for large-scale nonlinear equations with convex constraints. J. App. Math. Comp., (2014) Accepted.
Zheng, L.: A new projection algorithm for solving a system of nonlinear equations with convex constraints. Bull. Korean Math. Soc. 50, 823–832 (2013)
Zhou, W.J., Li, D.H.: A globally convergent BFGS method for nonlinear monotone equations without any merit functions. Math. Comput. 77, 2231–2240 (2008)
Chen, Z.X., Cheng, W.Y., Li, X.L.: A global convergent quasi-Newton method for systems of monotone equations 44, 455–465 (2014)
Cheng, W.Y.: A PRP type method for systems of monotone equations. Mathematical and Computer Modelling 50, 15–20 (2009)
Zhang, L., Zhou, W.J., Li, D.H.: Some descent three-term conjugate gradient methods and their global convergence. Optim. Meth. Softw. 22, 697–711 (2007)
Solodov, M.V., Svaiter, B.F.: A globally convergent inexact Newton method for systems of monotone equations. In: Fukushima, M., Qi, L. (eds.) Reformulation: Nonsmooth, Piecewise smooth, Semismooth and Smoothing Methods, pp. 335–369. Kluwer Academic Publishers, (1998).
Wang, C.W., Wang, Y.J., Xu, C.L.: A projection method for a system of nonlinear monotone equations with convex constraints. Math. Meth. Oper. Res. 66, 33–46 (2007)
Acknowledgments
The authors would like to thank the referees for giving us many valuable suggestions and comments, which improve this paper greatly. This work was partially supported by the domestic visiting scholar project funding of Shandong Province outstanding young teachers in higher schools, the foundation of Scientific Research Project of Shandong Universities (No. J13LI03), the NSF of Shandong Province, China and the Shandong Province Statistical Research Project (No. 20143038).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sun, M., Liu, J. A modified Hestenes–Stiefel projection method for constrained nonlinear equations and its linear convergence rate. J. Appl. Math. Comput. 49, 145–156 (2015). https://doi.org/10.1007/s12190-014-0829-7
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12190-014-0829-7