Skip to main content
Log in

A parameterized Newton method and a quasi-Newton method for nonsmooth equations

  • Published:
Computational Optimization and Applications Aims and scope Submit manuscript

Abstract

This paper presents a parameterized Newton method using generalized Jacobians and a Broyden-like method for solving nonsmooth equations. The former ensures that the method is well-defined even when the generalized Jacobian is singular. The latter is constructed by using an approximation function which can be formed for nonsmooth equations arising from partial differential equations and nonlinear complementarity problems. The approximation function method generalizes the splitting function method for nonsmooth equations. Locally superlinear convergence results are proved for the two methods. Numerical examples are given to compare the two methods with some other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. X. Chen, On the convergence of Broyden-like methods for nonlinear equations with nondifferentiable terms, Ann. Inst. Statist. Math. 42(1990) 387–401.

    Google Scholar 

  2. X. Chen, M.Z. Nashed and L. Qi, Convergence of Newton's method for singular smooth and nonsmooth equations using adaptive outer inverses, Applied Mathematics Preprint AM93/4, School of Mathematics, The University of New South Wales (Sydney, Australia 1993).

    Google Scholar 

  3. X. Chen and T. Yamamoto, On the convergence of some quasi-Newton methods for nonlinear equations with nondifferentiable operators, Computing 48(1992) 87–94.

    Google Scholar 

  4. X. Chen and T. Yamamoto, Newton-like methods for solving underdetermined nonlinear equations, to appear in: J. of Comp. App. Math.

  5. F.H. Clarke, Optimization and Nonsmooth Analysis, John Wiley and Sons, New York, 1983.

    Google Scholar 

  6. J.E. Dennis, Jr and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Inc., 1983.

  7. M. Ferris and S. Lucidi, Globally convergence methods for nonlinear equations, Computer Sciences Technical Report #1030, Computer Sciences Department, University of Wisconsin, (Madison, USA 1991).

    Google Scholar 

  8. M. Fukushima, Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems, Math. Programming 53(1992) 99–110.

    Google Scholar 

  9. S.A. Gabriel and J.S. Pang, A trust region method for constrained nonsmooth equations, W.W. Hager, D.W. Hearn and P.M. Pardalos, ed., Large Scale Optimization: State of the Art, Kluwer Academic Publishers B.V. (1994) 159–186.

  10. S.P. Han, J.S. Pang and N. Rangaraj Globally convergent Newton methods for nonsmooth equations, Math. Oper. Res. 17(1992) 586–607.

    Google Scholar 

  11. T. Hansen and T.C. Koopmans, On the definition and computation of capital stock invariant under optimization, J. Economic Theory 5(1972) 487–523.

    Google Scholar 

  12. P.T. Harker, Accelerating the convergence of the diagonalization and projection algorithms for finite-dimensional variational inequalities, Math. Programming 41(1988) 25–59.

    Google Scholar 

  13. M. Heinkenschloss, C.T. Kelley and H.T. Tran, Fast algorithms for nonsmooth compact fixed point problems, SIAM J. Numer. Anal. 29(1992) 1769–1792.

    Google Scholar 

  14. C.M. Ip and J. Kyparisis, Local convergence of quasi-Newton methods for B-differentiable equations. Math. Programming 56(1992) 71–89.

    Google Scholar 

  15. M. Kojima and S. Shindo, Extensions of Newton and quasi-Newton methods to systems ofPC 1 equations, J. Oper. Res. Soc. of Japan, 29(1986) 352–374.

    Google Scholar 

  16. B. Kummer, Newton's method for non-differentiable functions, in J. Guddat, B. Bank, H. Hollatz P. Kall, D. Klatte, B. Kummer, K. Lommatzsch, L. Tammer, M. Vlach and K. Zimmerman, eds., Advances in Mathematical Optimization, Akademi-Verlag, Berlin, (1988) 114–125.

    Google Scholar 

  17. J.M. Martínez and M.C. Zambaldi, Least change update methods for nonlinear systems with nondifferentiable terms. Numer. Funct. Anal. and Optimiz. 14(1993) 405–415.

    Google Scholar 

  18. M.Z. Nashed and X. Chen, Convergence of Newton-like methods for singular operator equations using outer inverses, Numer. Math. 66(1993) 235–257.

    Google Scholar 

  19. J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several, Variables, Academic Press, New York, 1970.

    Google Scholar 

  20. J.S. Pang, Newton's method for B-differentiable equations, Math. of Oper. Res. 15(1990) 311–341.

    Google Scholar 

  21. J.S. Pang, A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems, Math. Programming 51(1991) 101–131.

    Google Scholar 

  22. J.S. Pang and S.A. Gabriel, NE/SQP: A robust algorithm for the nonlinear complementarity problem, Math. Programming 60(1993) 295–337.

    Google Scholar 

  23. J.S. Pang and L. Qi, Nonsmooth equations: motivation and algorithms, SIAM J. Optimization 3(1993) 443–465.

    Google Scholar 

  24. L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations, Math. Oper. Res. 18(1993) 227–244.

    Google Scholar 

  25. L. Qi, Trust region algorithms for solving nonsmooth equations, to appear in SIAM J Optimization.

  26. L. Qi and X. Chen, A globally convergent successive approximation method for nonsmooth equations, to appear in SIAM J. Control & Optimization.

  27. L. Qi and J. Sun, A nonsmooth version of Newton's method, Math. Programming 58(1993) 353–367.

    Google Scholar 

  28. D. Ralph, Global convergence of damped Newton's method for nonsmooth equations via the path search, to appear in: Math. Oper. Res.

  29. S.M. Robinson, Newton's method for a class of nonsmooth functions, Industrial Engineering Working Paper, University of Wisconsin, (Madison, USA 1988).

    Google Scholar 

  30. H. Scarf, The Computation of Economic Equilibria, Yale University Press(1973).

  31. A. Shapiro, On concepts of directional differentiability. J. Optimiz. Theory. Appl. 66(1990) 477–487.

    Google Scholar 

  32. T. Yamamoto, A note on a posteriori error bound of Zabrejko and Nguen for Zincenko's iteration, Numer. Funct. Anal. and Optimiz. 9(1987) 987–994.

    Google Scholar 

  33. T. Yamamoto and X. Chen. Ball-convergence theorems and error estimates for certain iterative methods for nonlinear equations, Japan J. Appl. Math. 7(1990) 131–143.

    Google Scholar 

  34. A.I. Zincenko, Some approximate methods of solving equations with nondifferentiable operators (Ukrainian), Dopovidi Akad. Nauk. Ukrain. RSR (1963) 156–161.

Download references

Author information

Authors and Affiliations

Authors

Additional information

This work is supported by the Australian Research Council.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, X., Qi, L. A parameterized Newton method and a quasi-Newton method for nonsmooth equations. Comput Optim Applic 3, 157–179 (1994). https://doi.org/10.1007/BF01300972

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01300972

Keywords

Navigation