Abstract
This paper presents a parameterized Newton method using generalized Jacobians and a Broyden-like method for solving nonsmooth equations. The former ensures that the method is well-defined even when the generalized Jacobian is singular. The latter is constructed by using an approximation function which can be formed for nonsmooth equations arising from partial differential equations and nonlinear complementarity problems. The approximation function method generalizes the splitting function method for nonsmooth equations. Locally superlinear convergence results are proved for the two methods. Numerical examples are given to compare the two methods with some other methods.
Similar content being viewed by others
References
X. Chen, On the convergence of Broyden-like methods for nonlinear equations with nondifferentiable terms, Ann. Inst. Statist. Math. 42(1990) 387–401.
X. Chen, M.Z. Nashed and L. Qi, Convergence of Newton's method for singular smooth and nonsmooth equations using adaptive outer inverses, Applied Mathematics Preprint AM93/4, School of Mathematics, The University of New South Wales (Sydney, Australia 1993).
X. Chen and T. Yamamoto, On the convergence of some quasi-Newton methods for nonlinear equations with nondifferentiable operators, Computing 48(1992) 87–94.
X. Chen and T. Yamamoto, Newton-like methods for solving underdetermined nonlinear equations, to appear in: J. of Comp. App. Math.
F.H. Clarke, Optimization and Nonsmooth Analysis, John Wiley and Sons, New York, 1983.
J.E. Dennis, Jr and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Inc., 1983.
M. Ferris and S. Lucidi, Globally convergence methods for nonlinear equations, Computer Sciences Technical Report #1030, Computer Sciences Department, University of Wisconsin, (Madison, USA 1991).
M. Fukushima, Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems, Math. Programming 53(1992) 99–110.
S.A. Gabriel and J.S. Pang, A trust region method for constrained nonsmooth equations, W.W. Hager, D.W. Hearn and P.M. Pardalos, ed., Large Scale Optimization: State of the Art, Kluwer Academic Publishers B.V. (1994) 159–186.
S.P. Han, J.S. Pang and N. Rangaraj Globally convergent Newton methods for nonsmooth equations, Math. Oper. Res. 17(1992) 586–607.
T. Hansen and T.C. Koopmans, On the definition and computation of capital stock invariant under optimization, J. Economic Theory 5(1972) 487–523.
P.T. Harker, Accelerating the convergence of the diagonalization and projection algorithms for finite-dimensional variational inequalities, Math. Programming 41(1988) 25–59.
M. Heinkenschloss, C.T. Kelley and H.T. Tran, Fast algorithms for nonsmooth compact fixed point problems, SIAM J. Numer. Anal. 29(1992) 1769–1792.
C.M. Ip and J. Kyparisis, Local convergence of quasi-Newton methods for B-differentiable equations. Math. Programming 56(1992) 71–89.
M. Kojima and S. Shindo, Extensions of Newton and quasi-Newton methods to systems ofPC 1 equations, J. Oper. Res. Soc. of Japan, 29(1986) 352–374.
B. Kummer, Newton's method for non-differentiable functions, in J. Guddat, B. Bank, H. Hollatz P. Kall, D. Klatte, B. Kummer, K. Lommatzsch, L. Tammer, M. Vlach and K. Zimmerman, eds., Advances in Mathematical Optimization, Akademi-Verlag, Berlin, (1988) 114–125.
J.M. Martínez and M.C. Zambaldi, Least change update methods for nonlinear systems with nondifferentiable terms. Numer. Funct. Anal. and Optimiz. 14(1993) 405–415.
M.Z. Nashed and X. Chen, Convergence of Newton-like methods for singular operator equations using outer inverses, Numer. Math. 66(1993) 235–257.
J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several, Variables, Academic Press, New York, 1970.
J.S. Pang, Newton's method for B-differentiable equations, Math. of Oper. Res. 15(1990) 311–341.
J.S. Pang, A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems, Math. Programming 51(1991) 101–131.
J.S. Pang and S.A. Gabriel, NE/SQP: A robust algorithm for the nonlinear complementarity problem, Math. Programming 60(1993) 295–337.
J.S. Pang and L. Qi, Nonsmooth equations: motivation and algorithms, SIAM J. Optimization 3(1993) 443–465.
L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations, Math. Oper. Res. 18(1993) 227–244.
L. Qi, Trust region algorithms for solving nonsmooth equations, to appear in SIAM J Optimization.
L. Qi and X. Chen, A globally convergent successive approximation method for nonsmooth equations, to appear in SIAM J. Control & Optimization.
L. Qi and J. Sun, A nonsmooth version of Newton's method, Math. Programming 58(1993) 353–367.
D. Ralph, Global convergence of damped Newton's method for nonsmooth equations via the path search, to appear in: Math. Oper. Res.
S.M. Robinson, Newton's method for a class of nonsmooth functions, Industrial Engineering Working Paper, University of Wisconsin, (Madison, USA 1988).
H. Scarf, The Computation of Economic Equilibria, Yale University Press(1973).
A. Shapiro, On concepts of directional differentiability. J. Optimiz. Theory. Appl. 66(1990) 477–487.
T. Yamamoto, A note on a posteriori error bound of Zabrejko and Nguen for Zincenko's iteration, Numer. Funct. Anal. and Optimiz. 9(1987) 987–994.
T. Yamamoto and X. Chen. Ball-convergence theorems and error estimates for certain iterative methods for nonlinear equations, Japan J. Appl. Math. 7(1990) 131–143.
A.I. Zincenko, Some approximate methods of solving equations with nondifferentiable operators (Ukrainian), Dopovidi Akad. Nauk. Ukrain. RSR (1963) 156–161.
Author information
Authors and Affiliations
Additional information
This work is supported by the Australian Research Council.
Rights and permissions
About this article
Cite this article
Chen, X., Qi, L. A parameterized Newton method and a quasi-Newton method for nonsmooth equations. Comput Optim Applic 3, 157–179 (1994). https://doi.org/10.1007/BF01300972
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01300972