Skip to main content

Approximations to the Clarke Generalized Jacobians and Nonsmooth Least-Squares Minimization

  • Chapter
Progress in Optimization

Part of the book series: Applied Optimization ((APOP,volume 30))

  • 556 Accesses

Abstract

Here we use a uniform approximation to the Clarke generalized Jacobian to design an algorithm for solving a class of nonsmooth least-squares minimization problems: \(\min \phi (x) \equiv \frac{1}{2}\sum\nolimits_{i = 1}^m {{f_i}{{(x)}^2} \equiv \frac{1}{2}F{{(x)}^T}F(x),} \) where F : ℝn → ℝm is a locally Lipschitz mapping. We approximate the Clarke subdifferential of φ by approximating the Clarke generalized Jacobian of F. Regularity conditions for global convergence are discussed in details.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S.C. Billups, Algorithms for complementarity problems and generalized equations. Mathematical Programming Technical Report 95-14, Department of Computer Sciences, University of Wisconsin, Madison, 1995.

    Google Scholar 

  2. D.B. Bertsekas, S.K. Mitter, A descent numerical method for optimization problems with nondifferentiable cost functionals. SIAM Journal of Control, 11, 1973, 637–652.

    Article  MathSciNet  MATH  Google Scholar 

  3. F.H. Clarke, Optimization and Nonsmooth Analysis. John Wiley, New York, 1983.

    MATH  Google Scholar 

  4. B. D. Craven, B.M. Glover, Invex functions and duality. Journal of Australian Mathematical Society, Series A, 39, 1985, 1–20.

    Article  MathSciNet  MATH  Google Scholar 

  5. V.F., Demyanov, Algorithms for some minimax problems. Journal of Computer and System Sciences, 2, 1968, 342–380.

    Article  MathSciNet  MATH  Google Scholar 

  6. V.F., Demyanov, A.M. Rubinov, Constructive Nonsmooth Analysis. Verlag Peter Lang, Germany, 1995.

    MATH  Google Scholar 

  7. V.F., Demyanov, A.M. Rubinov, Quasidifferential Calculus. Optimization Software, New York, 1986.

    MATH  Google Scholar 

  8. M.C. Ferris, D. Ralph, Projected gradient methods for nonlinear complementarity problems via normal maps. In Recent Advances in Nonsmooth Optimization, D.-Z. Du et al eds., World Scientific Publishing, New Jersey, 1995.

    Google Scholar 

  9. R. Fletcher, Practical Methods of Optimization, Volume 2: Constrained Optimization. John Wiley, New York, 1981.

    Google Scholar 

  10. A.A. Goldstein, Optimization of Lipschitz continuous functions. Mathematical Programming, 13, 1977, 14–22.

    Article  MathSciNet  MATH  Google Scholar 

  11. S.P., Han, J.S. Pang, N. Rangaraj, Globally convergent Newton methods for nonsmooth equations. Mathematics of Operation Research, 17, 1992, 586–607.

    Article  Google Scholar 

  12. J.-B. Hiriart-Urruty, Refinements of necessary optimality conditions in nondifferentiable programming I. Applied Mathematics and Optimization, 5, 1979, 63–82.

    Article  MathSciNet  MATH  Google Scholar 

  13. J.-B. Hiriart-Urruty, Refinements of necessary optimality conditions in nondifferentiable programming II. Mathematical Programming Study, 19, 1982, 120–139.

    MathSciNet  Google Scholar 

  14. K.C., Kiwiel, Methods of Descent for Nondifferentiable Optimization. Lecture Notes in Mathematics, Springer-Verlag, Berlin, 1133, 1985.

    Google Scholar 

  15. C. Lemarechal, Extensions Diverses des Methodes de Gradient et Application. These d’etat, Paris, 1980.

    Google Scholar 

  16. C. Lemarechal, J. Zowe, A condensed introduction to bundle methods in nonsmooth optimization. In Algorithms for Continuous Optimization, E. Spedicato, ed., Kluwer Academic, Dordrecht, 1994.

    Google Scholar 

  17. Z.-Q. Luo, J.-S. Pang, D. Ralph, Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge, 1996.

    Google Scholar 

  18. J.-S. Pang, Newton’s method for B-diffecentiable equations. Mathematics of Operation Research, 15, 1990, 311–341.

    Article  MATH  Google Scholar 

  19. J.-S. Pang, A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems. Mathematical Programming, 51, 1991, 101–131.

    Article  MathSciNet  MATH  Google Scholar 

  20. J.-S. Pang, L. Qi, Nonsmooth equations: Motivation and algorithms. SIAM Journal of Optimization, 3, 1993, 443–465.

    Article  MathSciNet  MATH  Google Scholar 

  21. E. Polak, D.Q. Mayne, Algorithm models for nondifferentiable optimization. SIAM Journal of Control and Optimization, 23, 1985, 477–491.

    Article  MathSciNet  MATH  Google Scholar 

  22. E. Polak, D.Q. Mayne, Y. Wardi, On the extension of constrained optimization algorithms from differentiable to nondifferentiable problems. SIAM Journal of Control and Optimization, 21, 1983, 179–203.

    Article  MathSciNet  MATH  Google Scholar 

  23. E. Polak, A. Sangiovanni-Vincentelli, Theoretical and computational aspects of the optimal design centering, tolerancing, and tuning problem. IEEE Transaction on Circuits and Systems, 26, 1979, 795–813.

    Article  MathSciNet  MATH  Google Scholar 

  24. L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations. Mathematics of Operations Research, 18, 1993, 227–244.

    Article  MathSciNet  MATH  Google Scholar 

  25. L. Qi, J. Sun, A nonsmooth version of Newton method. Mathematical Programming, 58, 1993, 353–367.

    Article  MathSciNet  MATH  Google Scholar 

  26. D. Ralph, Global convergence of damped Newton’s method for nonsmooth equations via the path search. Mathematics of Operations Research, 19, 1994, 352–389.

    Article  MathSciNet  MATH  Google Scholar 

  27. R.T. Rockafellar, Convex Analysis. Princeton University Press, Princeton, 1970.

    MATH  Google Scholar 

  28. A.M. Rubinov, Upper semi-continuously directionally differentiate functions. In Lecture Notes in Economic and Mathematical Systems 255, V.F. Demyanov and D. Pallaschke eds., Springer-Verlag, Berlin, 1985.

    Google Scholar 

  29. P.H. Wolfe, A method of conjugate subgradients of minimizing nondifferentiable convex functions. Mathematical Programming Study, 3, 1975, 145–173.

    MathSciNet  Google Scholar 

  30. H. Xu, X.-W. Chang, Approximate Newton methods for nonsmooth equations. Journal of Optimization Theory and Applications, 93, 1997, 373–394.

    Article  MathSciNet  MATH  Google Scholar 

  31. Xu, H., and Glover B. M., New version of Newton’s method for non- smooth equations. Journal of Optimization Theory and Applications, 93, 1997, 395–415.

    Article  MathSciNet  MATH  Google Scholar 

  32. H. Xu, B.M. Glover, A.M. Rubinov, Approximations to generalized Jacobian. School of information technology and Mathematical Sciences, University of Ballarat, Victoria, Australia, 1996.

    Google Scholar 

  33. Y. Yuan, On the superlinear convergence of a trust region algorithm for nonsmooth optimization. Mathematical Programming, 31, 1985, 269–285.

    Article  MathSciNet  MATH  Google Scholar 

  34. I. Zang, E.U. Choo, M. Avriel, On functions whose stationary points are global minima. Journal of Optimization Theory and Applications, 22, 1977, 195–207.

    Article  MathSciNet  MATH  Google Scholar 

  35. J. Zowe, Nondifferentiable optimization: A motivation and a short introduction into the subgradient and the bundle concept. In Computational Mathematical Programming, K. Schittkowski, ed., Springer-Verlag, Berlin, 1985.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Kluwer Academic Publishers

About this chapter

Cite this chapter

Xu, H., Rubinov, A.M., Glover, B.M. (1999). Approximations to the Clarke Generalized Jacobians and Nonsmooth Least-Squares Minimization. In: Progress in Optimization. Applied Optimization, vol 30. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-3285-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-3285-5_10

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-3287-9

  • Online ISBN: 978-1-4613-3285-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics