Abstract
Here we use a uniform approximation to the Clarke generalized Jacobian to design an algorithm for solving a class of nonsmooth least-squares minimization problems: \(\min \phi (x) \equiv \frac{1}{2}\sum\nolimits_{i = 1}^m {{f_i}{{(x)}^2} \equiv \frac{1}{2}F{{(x)}^T}F(x),} \) where F : ℝn → ℝm is a locally Lipschitz mapping. We approximate the Clarke subdifferential of φ by approximating the Clarke generalized Jacobian of F. Regularity conditions for global convergence are discussed in details.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S.C. Billups, Algorithms for complementarity problems and generalized equations. Mathematical Programming Technical Report 95-14, Department of Computer Sciences, University of Wisconsin, Madison, 1995.
D.B. Bertsekas, S.K. Mitter, A descent numerical method for optimization problems with nondifferentiable cost functionals. SIAM Journal of Control, 11, 1973, 637–652.
F.H. Clarke, Optimization and Nonsmooth Analysis. John Wiley, New York, 1983.
B. D. Craven, B.M. Glover, Invex functions and duality. Journal of Australian Mathematical Society, Series A, 39, 1985, 1–20.
V.F., Demyanov, Algorithms for some minimax problems. Journal of Computer and System Sciences, 2, 1968, 342–380.
V.F., Demyanov, A.M. Rubinov, Constructive Nonsmooth Analysis. Verlag Peter Lang, Germany, 1995.
V.F., Demyanov, A.M. Rubinov, Quasidifferential Calculus. Optimization Software, New York, 1986.
M.C. Ferris, D. Ralph, Projected gradient methods for nonlinear complementarity problems via normal maps. In Recent Advances in Nonsmooth Optimization, D.-Z. Du et al eds., World Scientific Publishing, New Jersey, 1995.
R. Fletcher, Practical Methods of Optimization, Volume 2: Constrained Optimization. John Wiley, New York, 1981.
A.A. Goldstein, Optimization of Lipschitz continuous functions. Mathematical Programming, 13, 1977, 14–22.
S.P., Han, J.S. Pang, N. Rangaraj, Globally convergent Newton methods for nonsmooth equations. Mathematics of Operation Research, 17, 1992, 586–607.
J.-B. Hiriart-Urruty, Refinements of necessary optimality conditions in nondifferentiable programming I. Applied Mathematics and Optimization, 5, 1979, 63–82.
J.-B. Hiriart-Urruty, Refinements of necessary optimality conditions in nondifferentiable programming II. Mathematical Programming Study, 19, 1982, 120–139.
K.C., Kiwiel, Methods of Descent for Nondifferentiable Optimization. Lecture Notes in Mathematics, Springer-Verlag, Berlin, 1133, 1985.
C. Lemarechal, Extensions Diverses des Methodes de Gradient et Application. These d’etat, Paris, 1980.
C. Lemarechal, J. Zowe, A condensed introduction to bundle methods in nonsmooth optimization. In Algorithms for Continuous Optimization, E. Spedicato, ed., Kluwer Academic, Dordrecht, 1994.
Z.-Q. Luo, J.-S. Pang, D. Ralph, Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge, 1996.
J.-S. Pang, Newton’s method for B-diffecentiable equations. Mathematics of Operation Research, 15, 1990, 311–341.
J.-S. Pang, A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems. Mathematical Programming, 51, 1991, 101–131.
J.-S. Pang, L. Qi, Nonsmooth equations: Motivation and algorithms. SIAM Journal of Optimization, 3, 1993, 443–465.
E. Polak, D.Q. Mayne, Algorithm models for nondifferentiable optimization. SIAM Journal of Control and Optimization, 23, 1985, 477–491.
E. Polak, D.Q. Mayne, Y. Wardi, On the extension of constrained optimization algorithms from differentiable to nondifferentiable problems. SIAM Journal of Control and Optimization, 21, 1983, 179–203.
E. Polak, A. Sangiovanni-Vincentelli, Theoretical and computational aspects of the optimal design centering, tolerancing, and tuning problem. IEEE Transaction on Circuits and Systems, 26, 1979, 795–813.
L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations. Mathematics of Operations Research, 18, 1993, 227–244.
L. Qi, J. Sun, A nonsmooth version of Newton method. Mathematical Programming, 58, 1993, 353–367.
D. Ralph, Global convergence of damped Newton’s method for nonsmooth equations via the path search. Mathematics of Operations Research, 19, 1994, 352–389.
R.T. Rockafellar, Convex Analysis. Princeton University Press, Princeton, 1970.
A.M. Rubinov, Upper semi-continuously directionally differentiate functions. In Lecture Notes in Economic and Mathematical Systems 255, V.F. Demyanov and D. Pallaschke eds., Springer-Verlag, Berlin, 1985.
P.H. Wolfe, A method of conjugate subgradients of minimizing nondifferentiable convex functions. Mathematical Programming Study, 3, 1975, 145–173.
H. Xu, X.-W. Chang, Approximate Newton methods for nonsmooth equations. Journal of Optimization Theory and Applications, 93, 1997, 373–394.
Xu, H., and Glover B. M., New version of Newton’s method for non- smooth equations. Journal of Optimization Theory and Applications, 93, 1997, 395–415.
H. Xu, B.M. Glover, A.M. Rubinov, Approximations to generalized Jacobian. School of information technology and Mathematical Sciences, University of Ballarat, Victoria, Australia, 1996.
Y. Yuan, On the superlinear convergence of a trust region algorithm for nonsmooth optimization. Mathematical Programming, 31, 1985, 269–285.
I. Zang, E.U. Choo, M. Avriel, On functions whose stationary points are global minima. Journal of Optimization Theory and Applications, 22, 1977, 195–207.
J. Zowe, Nondifferentiable optimization: A motivation and a short introduction into the subgradient and the bundle concept. In Computational Mathematical Programming, K. Schittkowski, ed., Springer-Verlag, Berlin, 1985.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1999 Kluwer Academic Publishers
About this chapter
Cite this chapter
Xu, H., Rubinov, A.M., Glover, B.M. (1999). Approximations to the Clarke Generalized Jacobians and Nonsmooth Least-Squares Minimization. In: Progress in Optimization. Applied Optimization, vol 30. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-3285-5_10
Download citation
DOI: https://doi.org/10.1007/978-1-4613-3285-5_10
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-3287-9
Online ISBN: 978-1-4613-3285-5
eBook Packages: Springer Book Archive