Abstract
We present a superlinearly convergent method to solve a constrained system of nonlinear equations. The proposed procedure is an adaptation of the linear-programming-Newton method replacing the first-order information with a secant update. Thus, under mild assumptions, the method is able to find possible nonisolated solutions without computing any derivative and achieving a local superlinear rate of convergence. In addition to the convergence analysis, some numerical examples are presented in order to show the fulfillment of the expected rate of convergence.
Similar content being viewed by others
References
Facchinei, F., Fischer, A., Herrich, M.: An LP-Newton method: nonsmooth equations, KKT systems, and nonisolated solutions. Math. Program. 146(1–2), 1–36 (2014)
Martínez, M.D.L.Á., Fernández, D.: A quasi-Newton modified LP-Newton method. In: Optimization Methods and Software, pp. 1–16 (2017)
Dennis Jr., J.E., Schnabel, R.B.: Least change secant updates for quasi-Newton methods. Siam Rev. 21(4), 443–459 (1979)
Martınez, J.M.: Practical quasi-Newton methods for solving nonlinear systems. J. Comput. Appl. Math. 124(1), 97–121 (2000)
Dembo, R.S., Eisenstat, S.C., Steihaug, T.: Inexact Newton methods. SIAM J. Numer. Anal. 19(2), 400–408 (1982)
Izmailov, A.F., Solodov, M.V.: Newton-Type Methods for Optimization and Variational Problems. Springer, Berlin (2014)
Kanzow, C.: An active set-type Newton method for constrained nonlinear systems. Complement. Appl. Algorithms Ext. 50, 179–200 (2001)
Kozakevich, D.N., Martinez, J.M., Santos, S.A.: Solving nonlinear systems of equations with simple constraints. Comput. Appl. Math. 16(3), 215–235 (1997)
Ulbrich, M.: Nonmonotone trust-region methods for bound-constrained semismooth equations with applications to nonlinear mixed complementarity problems. SIAM J. Optim. 11(4), 889–917 (2001)
Yamashita, N., Fukushima, M.: On the rate of convergence of the Levenberg–Marquardt method. In: Alefeld, G., Chen, X. (eds.) Topics in Numerical Analysis. Computing Supplementa, vol. 15, pp. 239–249. Springer, Vienna (2001)
Fan, J.Y., Yuan, Y.X.: On the quadratic convergence of the Levenberg–Marquardt method without nonsingularity assumption. Computing 74(1), 23–39 (2005)
Fischer, A.: Local behavior of an iterative framework for generalized equations with nonisolated solutions. Math. Program. 94(1), 91–124 (2002)
Fischer, A., Herrich, M., Izmailov, A.F., Solodov, M.V.: A globally convergent LP-Newton method. SIAM J. Optim. 26(4), 2012–2033 (2016)
Izmailov, A.F., Solodov, M.V.: On error bounds and Newton-type methods for generalized nash equilibrium problems. Comput. Optim. Appl. 59(1–2), 201–218 (2014)
Fischer, A., Herrich, M., Izmailov, A.F., Solodov, M.V.: Convergence conditions for Newton-type methods applied to complementarity systems with nonisolated solutions. Comput. Optim. Appl. 63(2), 425–459 (2016)
Bonnans, J.F.: Local analysis of Newton-type methods for variational inequalities and nonlinear programming. Appl. Math. Optim. 29(2), 161–186 (1994)
Fan, J.: Convergence rate of the trust region method for nonlinear equations under local error bound condition. Comput. Optim. Appl. 34(2), 215–227 (2006)
Acknowledgements
This work was partially supported by FONCyT Grant PICT 2014-2534 and CONICET Grant PIP 112-201101-00050.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Alexey F. Izmailov.
Rights and permissions
About this article
Cite this article
Martínez, M.Á., Fernández, D. On the Local and Superlinear Convergence of a Secant Modified Linear-Programming-Newton Method. J Optim Theory Appl 180, 993–1010 (2019). https://doi.org/10.1007/s10957-018-1407-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-018-1407-1
Keywords
- Constrained nonlinear system of equations
- Nonisolated solutions
- Quasi-Newton method
- Local superlinear convergence