Abstract
In this article we review and summarize recent developments on nonsmooth equations and smoothing Newton methods. Several new suggestions are presented.
This work is supported by the Australian Research Council.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S.C. Billups, Algorithms for complementarity problems and generalized equations. Ph.D thesis, Department of Computer Sciences, University of Wisconsin-Madison, USA, 1995.
S.C. Billups and M.C. Ferris, QPCOMP: a quadratic programming based solver for mixed complementarity problems. Mathematical Programming, 76, 1997, 533–562.
J. Burke and S. Xu, A non-interior predictor-corrector path following algorithm for the monotone linear complementarity problem. Preprint, Department of Mathematics, University of Washington, Seattle, WA 98195, September 1997.
J. Burke and S. Xu, A polynomial time interior-point path-following algorithm for LCP based on Chen-Harker-Kanzow smoothing techniques. To appear in Mathematical Programming.
J. Burke and S. Xu, The global linear convergence of a non-interior path- following algorithm for linear complementarity problem. To appear in Mathematics of Operations Research.
J. Burke and S. Xu, A non-interior predictor-corrector path following method for LCP. In Reformulation - Nonsmooth, Piecewise Smooth, Semis- mooth and Smoothing Methods, M. Fukushima and L. Qi, eds., Kluwer Academic Publisher, Nowell, Maryland, 1998, 45–64.
B. Chen and X. Chen, A global linear and local quadratic continuation smoothing method for variational inequalities with box constraints. Preprint, Department of Management and Systems, Washington State University, Pullman, March 1997.
B. Chen and X. Chen, A global and local superlinear continuation- smoothing method for P0 + R0 and monotone NCP. To appear in SIAM Journal on Optimization.
B. Chen, X. Chen and C. Kanzow, A penalized Fischer-Burmeister NCP- function: theoretical investigation and numerical results. Applied Mathematics Report 97/28, School of Mathematics, The University of New South Wales, Sydney 2052, Australia, September 1997.
B. Chen and P.T. Harker, A non-interior-point continuation method for linear complementarity problems. SIAM Journal on Matrix Analysis and Applications, 14, 1993, 1168–1190.
B. Chen and P.T. Harker, A continuation method for monotone variational inequalities. Mathematical Programming, 69, 1995, 237–253.
B. Chen and P.T. Harker, Smooth approximations to nonlinear complementarity problems. SIAM Journal on Optimization, 7, 1997, 403–420.
B. Chen and N. Xiu, A global linear and local quadratic non-interior continuation method for nonlinear complementarity problems based on Chen- Mangasarian smoothing function. To appear in SIAM Journal on Optimization.
C. Chen and O.L. Mangasarian, Smoothing methods for convex inequalities and linear complementarity problems. Mathematical Programming, 71, 1995, 51–69.
C. Chen and O.L. Mangasarian, A class of smoothing functions for nonlinear and mixed complementarity problems. Computational Optimization and Applications, 5, 1996, 97–138.
X. Chen, L. Qi and D. Sun, Global and superlinear convergence of the smoothing Newton method and its application to general box constrained variational inequalities. Mathematics of Computation, 67, 1998, 519–540.
X. Chen and Y. Ye, On homotopy-smoothing methods for variational inequalities. To appear in SIAM Journal on Control and Optimization.
F.H. Clarke, Optimization and Nonsmooth Analysis. Wiley, New York, 1983.
T. De Luca, F. Facchinei and C. Kanzow, A semismooth equation approach to the solution of nonlinear complementarity problems. Mathematical Programming, 75, 1996, 407–439.
T. De Luca, F. Facchinei and C. Kanzow, A theoretical and numerical comparison of some semismooth algorithms for complementarity problems. Mathematical Programming Technical Report 97–15, Computer Sciences Department, University of Wisconsin-Madison, Madison, WI, December 1997.
J.E. Dennis, Jr. and J. J. Moré, Quasi-Newton methods: Motivation and theory. SIAM Review, 19, 1977, 46–89.
J.E. Dennis, Jr. and R.B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Prentice-Hall, Englewood Cliffs, New Jersey, 1983.
S.P. Dirkse and M.C. Ferris, The PATH solver: A non-monotone stabilization scheme for mixed complementarity problems. Optimization Methods and Software, 5, 1995, 123–156
S.P. Dirkse and M.C. Ferris, MCPLIB: A collection of nonlinear mixed complementarity problems. Optimization Methods and Software, 5, 1995, 319–345.
S.P. Dirkse, M.C. Ferris, P.V. Preckel, and T. Rutherford, The GAMS callable program library for variational and complementarity solvers. Mathematical Programming Technical Report 94-07, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, 1994.
B.C. Eaves, On the basic theorem of complementarity. Mathematical Programming, 1, 1971, 68–75.
F. Facchinei, A. Fischer and C. Kanzow, Inexact Newton methods for semismooth equations with applications to variational inequality problems. In Nonlinear Optimization and Applications, G. Di Pillo and F. Giannessi, eds., Plenum Press, New York, 1996, 125 - 139.
F. Facchinei, A. Fischer and C. Kanzow, A semismooth Newton method for variational inequalities: The case of box constraints. In Complementarity and Variational Problems: State of the Art, M.C. Ferris and J.S. Pang, eds., SIAM, Philadelphia, Pennsylvania, 1997, 76–90.
F. Facchinei, A. Fischer and C. Kanzow, Regularity properties of a semismooth equation reformulation of variational inequalities. SIAM Journal on Optimization, 8, 1998, 850–869.
F. Facchinei, H. Jiang, and L. Qi, A smoothing method for mathematical programming with equilibrium constraints. To appear in Mathematical Programming.
F. Facchinei and C. Kanzow, A nonsmooth inexact Newton method for the solution of large-scale nonlinear complementarity problems. Mathematical Programming, 76, 1997, 493–512.
F. Facchinei and C. Kanzow, Beyond monotonicity in regularization methods for nonlinear complementarity problems. To appear in SIAM Journal on Control and Optimization.
F. Facchinei and J. Soares, A new merit function for nonlinear complementarity problems and a related algorithm. SIAM Journal on Optimization, 7, 1997, 225–247.
M. C. Ferris and T. F. Rutherford, Accessing realistic mixed complementarity problems within MATLAB. In Nonlinear Optimization and Applications, G. Di Pillo and F. Giannessi, eds., Plenum Press, New York, 1996, 141–153.
A. Fischer, A special Newton-type optimization method. Optimization, 24, 1992, 269–284.
A. Fischer, An NCP-function and its use for the solution of complementarity problems, in Recent Advances in Nonsmooth Optimization, D. Du, L, Qi and R. Womersley, eds., World Scientific Publishers, New Jersy, 1995, 88–105.
A. Fischer, Solution of monotone complementarity problems with locally Lipschitzian functions. Mathematical Programming, 76, 1997, 513–532.
M. Fukushima, Merit functions for variational inequality and complementarity problems. In Nonlinear Optimization and Applications, G. Di Pillo and F. Giannessi, eds., Plenum Publishing Corporation, New York, 1996, 155–170.
M. Fukushima, Z.-Q. Luo, and J.-S. Pang, A globally convergent sequential quadratic programming algorithm for mathematical programming problems with linear complementarity constraints. Computational Optimization and Applications, 10, 1998, 5–34.
S.A. Gabriel and J.J. More, Smoothing of mixed complementarity problems. In Complementarity and Variational Problems: State of the Art, M.C. Ferris and J.S. Pang, eds., SIAM, Philadelphia, Pennsylvania, 1997, 105–116.
C. Geiger and C. Kanzow, On the resolution of monotone complementarity problems. Computational Optimization and Applications, 5, 1996, 155–173.
M.S. Gowda and M.A. Tawhid, Existence and limiting behavior of associated with P0-equations. To appear in Computational Optimization and Applications.
P.T. Harker and J.-S. Pang, Finite-dimensional variational inequality and nonlinear complementarity problem: A survey of theory, algorithms and applications. Mathematical Programming, 48, 1990, 161–220.
P.T. Harker and B. Xiao, Newton method for the nonlinear complementarity problem: A B-differentiable equation approach. Mathematical Programming, 48, 1990, 339–357.
K. Hotta and A. Yoshise, Global convergence of a class of non-interior- point algorithms using Chen-Harker-Kanzow functions for nonlinear complementarity problems. Discussion Paper Series No. 708, Institute of Policy and Planning Sciences, University of Tsukuba, Tsukuba, Ibaraki 305, Japan, December 1996.
H. Jiang, Unconstrained minimization approaches to nonlinear complementarity problems. Journal of Global Optimization, 9, 1996, 169–181.
H. Jiang, Global convergence analysis of the generalized Newton and Gauss-Newton methods of the Fischer-Burmeister equation for the complementarity problem. To appear in Mathematics of Operations Research.
H. Jiang, Smoothed Fischer-Burmeister equation methods for the nonlinear complementarity problem. Preprint, Department of Mathematics & Statistics, The University of Melbourne, Victoria 3052, Australia, June 1997.
H. Jiang and L. Qi, A new nonsmooth equation approach to nonlinear complementarity problems. SIAM Journal on Control and Optimization, 35, 1997, 178–193.
H. Jiang, L. Qi, X. Chen and D. Sun, Semismoothness and superlinear convergence in nonsmooth optimization and nonsmooth equations. In Nonlinear Optimization and Applications, G. Di Pillo and F. Giannessi, eds., Plenum Publishing Corporation, New York, 1996, 197–212.
H. Jiang and D. Ralph, Smooth SQP methods for mathematical programs with nonlinear complementarity constraints. Manuscript, Department of Mathematics & Statistics, The University of Melbourne, December 1997.
H. Jiang and D. Ralph, Global and local superlinear convergence analysis of Newton-type methods for semismooth equations with smooth least squares. In Reformulation - Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, M. Fukushima and L. Qi, eds. Kluwer Academic Publisher, Nowell, Maryland, 1998, 181–210.
N.H. Josephy, Newton’s method for generalized equations. Technical Report 1965, Mathematics Research Center, University of Wisconsin, Madison, 1979.
N.H. Josephy, Quasi-Newton methods for generalized equations. Technical Report 1966, Mathematics Research Center, University of Wisconsin, Madison, 1979.
C. Kanzow, An unconstrained optimization technique for large-scale linearly constrained convex minimization problems. Computing, 53, 1994, 101–117.
C. Kanzow, Some equation-based methods for the nonlinear complementarity problem. Optimization Methods and Software, 3, 1994, 327–340.
C. Kanzow, Some noninterior continuation methods for linear complementarity problems. SIAM Journal on Matrix Analysis and Applications, 17, 1996, 851–868.
C. Kanzow and H. Jiang, A continuation method for (strongly) monotone variational inequalities. Mathematical Programming, 81, 1998, 140–157.
C. Kanzow and H. Kleinmichel, A new class of semismooth Newton-type methods for nonlinear complementarity problems. To appear in Computational Optimization and Applications.
C. Kanzow and H. Pieper, Jacobian smoothing methods for general complementarity problems. To appear in SIAM Journal on Optimization.
C. Kanzow and H.-D. Qi, A QP-free constrained Newton-type method for variational inequality problems. To appear in Mathematical Programming.
M. Kojima and S. Shindo, Extensions of Newton and quasi-Newton methods to systems of PC1 equations. Journal of Operations Research Society of Japan, 29, 1986, 352–374.
B. Kummer, Newton’s method for non-differentiable functions, in Advances in Mathematical Optimization, J. Guddat, B. Bank, H. Hollatz, P. Kail, D. Klatte, B. Kummer, K. Lommatzsch, L. Tammer, M. Vlach and K. Zimmerman, eds., Akademi-Verlag, Berlin, pp. 114–125, 1988.
B. Kummer, Newton’s method based on generalized derivatives for nonsmooth functions: Convergence analysis, in: W. Oettli and D. Pallaschke, eds., “Advances in Optimization”, Springer-Verlag, Berlin, 1992, 171–194.
O.L. Mangasarian, Unconstrained Lagrangians in nonlinear programming. SIAM Journal of Control, 13, 1975, 772–791.
O.L. Mangasarian, Unconstrained methods in nonlinear programming, in; Nonlinear Programming, SIAM-AMS Proceedings, Volume IX, American Math. Soc., Providence, Rhode Island, 169–184.
J.M. Martinez and L. Qi, Inexact Newton methods for solving nonsmooth equations. Journal of Computational and Applied Mathematics, 1995, 127–145.
R. Mifflin, Semismooth and semiconvex functions in constrained optimization. SIAM Journal on Control and Optimization, 15, 1977, 957–972.
J.J. Moré, Coercivity conditions in nonlinear complementarity problems. SIAM Review, 16, 1974, 1–16.
J.J. Moré, Global methods for nonlinear complementarity problems. Mathematics of Operations Research, 21, 1996, 589–614.
J.M. Ortega and W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York, 1970.
J.V. Outrata and J. Zowe, A Newton method for a class of quasi-variational inequalities. Computational Optimization and Applications, 4, 1995, 5–21.
J.-S. Pang, Newton’s method for B-differentiable equations. Mathematics of Operations Research, 15, 1990, 311–341.
J.S. Pang, A B-differentiable equation based, globally, and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems. Mathematical Programming, 51, 1991, 101–131.
J.S. Pang and D. Chan, Iterative methods for variational and complementarity problems. Mathematical Programming, 24, 1982, 284–313.
J.S. Pang and S.A. Gabriel, NE/SQP: A robust algorithm for the nonlinear complementarity problem. Mathematical Programming, 60, 1993, 295–337.
J.-S. Pang and L. Qi, Nonsmooth equations: Motivation and algorithms. SIAM Journal on Optimization, 3, 1993, 443–465.
J. Peng and Z. Lin, A non-interior continuation method for generalized linear complementarity problems. Preprint, Institute of Computational Mathematics and Scientific/Engineering Computing, Chinese Academy of Sciences, August 1997.
E. Polak, Optimization: Algorithms and Consistent Approximations. Springer, New York, 1997.
H.-D. Qi, A regularized smoothing Newton method for box constrained variational inequality problems with P0 functions. Preprint, Institute of Computational Mathematics and Scientific/Engineering Computing, Chinese Academy of Sciences, August 1997. Revised March 1998.
H.-D. Qi and L.Z. Liao, A smoothing Newton method for extended vertical linear complementarity problems. To appear in SIAM Journal on Matrix Analysis and Applications.
H.-D. Qi and L.Z. Liao, A smoothing Newton method for general nonlinear complementarity problems. Preprint, Institute of Computational Mathematics and Scientific/Engineering Computing, Chinese Academy of Sciences, March 1998.
L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations. Mathematics of Operations Research, 18, 1993, 227–244.
L. Qi, Trust region algorithms for solving nonsmooth equations. SIAM Journal on Optimization, 5, 1995, 219–230.
L. Qi, C-differentiability, C-Differential operators and generalized Newton methods. AMR 96/5, Applied Mathematics Report, The University of New South Wales, Sydney 2052, 1996.
L. Qi, Regular pseudo-smooth NCP and BVIP functions and globally and quadratically convergent generalized Newton methods for complementarity and variational inequality problems. To appear in Mathematics of Operations Research.
L. Qi and X. Chen, A globally convergent successive approximation method for severely nonsmooth equations. SIAM Journal on Control and Optimization, 33, 1995, 402–418.
L. Qi and H. Jiang, Semismooth Karush-Kuhn-Tucker equations and convergence analysis of Newton and quasi-Newton methods for solving these equations. Mathematics of Operations Research, 22, 1997, 301–325.
L. Qi and D. Sun, Improving the convergence of non-interior point algorithms for nonlinear complementarity problems. To appear in Mathematics of Computation.
L. Qi, D. Sun and G. Zhou, A new look at smoothing Newton methods for nonlinear complementarity problems and box constrained variational inequalities. AMR 97/13, Applied Mathematics Report, School of Mathematics, The University of New South Wales, Sydney 2052, Australia, June 1997. Revised August 1998.
L. Qi and J. Sun, A nonsmooth version of Newton’s method. Mathematical Programming, 58, 1993, 353–367.
D. Ralph, Global convergence of damped Newton’s method for nonsmooth equations, via the path search. Mathematics of Operations Research, 19, 1994, 352–389.
G. Ravindran and M.S. Gowda, Regularization of P0-functions in box variational inequality problems. To appear in SIAM Journal on Optimization.
S.M. Robinson, Strongly regular generalized equations. Mathematics of Operations Research, 5, (1980), 43–62.
S.M. Robinson, Generalized equations and their solutions, part II: Applications to nonlinear programming. Mathematical Programming Study, 19, 1982, 200–221.
S.M. Robinson, Generalized equations, in Mathematical Programming: The State of the Art, A. Bachem, M. Grotschel and B. Korte, eds., Springer- Verlag, Berlin, 1983, 346–347.
S.M. Robinson, An implicit-function theorem for a class of nonsmooth equations. Mathematics of Operations Research, 16, 1991, 292–309.
S. M. Robinson, Normal maps induced by linear transformation. Mathematics of Operations Research, 17, 1992, 691–714.
S.M. Robinson, Newton’s method for a class of nonsmooth functions. Set- Valued Analysis, 2, 1994, 291–305.
A. Shapiro, On concepts of directional differentiability. Journal of Optimization Theory and Applications, 66, 1990, 477–487.
S. Smale, Algorithms for solving equations,, in Proceedings of the International Congress of Mathematicians, Berkeley, California, 172–195, 1986.
D. Sun, A regularization Newton method for solving nonlinear complementarity problems. To appear in Applied Mathematics and Optimization.
D. Sun and J. Han, Newton and quasi-Newton methods for a class of non- smooth equations and related problems. SIAM Journal on Optimization, 7, 1997, 463–480.
D. Sun and L. Qi, On NCP-functions. To appear in Computational Optimization and Applications.
D. Sun and R. S. Womersley, A new unconstrained differentiate merit function for box constrained variational inequality problems and a damped Gauss-Newton method. To appear in SIAM Journal on Optimization.
R. Sznajder and M.S. Gowda, On the limiting behavior of trajectory of regularized solutions of a P0-complementarity problem. Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, M. Fukushima and L. Qi, eds., Kluwer Academic Publisher, Nowell, Maryland, 1998, 371–380.
P. Tseng, Global behaviour of a class of merit functions for the nonlinear complementarity problem. Journal of Optimization Theory and Applications, 89, 1996, 17–37.
P. Tseng, Analysis of a non-interior continuation method based on Chen- Mangasarian functions for complementarity problems. In Reformulation - Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, M. Fukushima and L. Qi, eds., Kluwer Academic Publisher, Norwell, Maryland, 1998, 381–404.
S. Wright, Primal-Dual Interior Point Methods. SIAM, Philadelphia, PA, 1997.
B. Xiao and P.T. Harker, A nonsmooth Newton method for variational inequalities, I: Theory. Mathematical Programming, 65, 1994, 151–194.
B. Xiao and P.T. Harker, A nonsmooth Newton method for variational inequalities, II: Numerical results. Mathematical Programming, 65, 1994, 195–216.
N. Yamashita and M. Fukushima, Modified Newton methods for solving semismooth reformulations of monotone complementarity problems. Mathematical Programming, 76, 1997, 469–491.
S. Xu, The global linear convergence of an infeasible non-interior path-following algorithm for complementarity problems with uniform P- functions. Preprint, Department of Mathematics, University of Washington, Seattle, WA 98195, December 1996.
S. Xu, The global linear convergence and complexity of a non-interior path-following algorithm for monotone LCP based on Chen-Harker- Kanzow-Smale smooth functions. Preprint, Department of Mathematics, University of Washington, Seattle, WA 98195, February 1997.
G. Zhou, D. Sun and L. Qi, Numerical experiments for a class of squared smoothing Newton methods for complementarity and variational inequality problems. To appear in Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, M. Fukushima and L. Qi, eds., Kluwer Academic Publisher, Nowell, Maryland, 1998, 421 –441.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1999 Kluwer Academic Publishers
About this chapter
Cite this chapter
Qi, L., Sun, D. (1999). A Survey of Some Nonsmooth Equations and Smoothing Newton Methods. In: Progress in Optimization. Applied Optimization, vol 30. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-3285-5_7
Download citation
DOI: https://doi.org/10.1007/978-1-4613-3285-5_7
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-3287-9
Online ISBN: 978-1-4613-3285-5
eBook Packages: Springer Book Archive