Advertisement

An algorithm for nonsmooth optimization by successive piecewise linearization

  • Sabrina Fiege
  • Andrea Walther
  • Andreas Griewank
Full Length Paper Series A
First Online:
  • 196 Downloads

Abstract

We present an optimization method for Lipschitz continuous, piecewise smooth (PS) objective functions based on successive piecewise linearization. Since, in many realistic cases, nondifferentiabilities are caused by the occurrence of abs(), max(), and min(), we concentrate on these nonsmooth elemental functions. The method’s idea is to locate an optimum of a PS objective function by explicitly handling the kink structure at the level of piecewise linear models. This piecewise linearization can be generated in its abs-normal-form by minor extension of standard algorithmic, or automatic, differentiation tools. In this paper it is shown that the new method when started from within a compact level set generates a sequence of iterates whose cluster points are all Clarke stationary. Numerical results including comparisons with other nonsmooth optimization methods then illustrate the capabilities of the proposed approach.

Keywords

Piecewise smoothness Nonsmooth optimization Algorithmic differentiation Abs-normal form Clarke stationary 

Mathematics Subject Classification

49J52 90C56 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

The authos are indebted to the two referees for their careful reading of the first submission and their many objections and suggestions, which helped to greatly improve the consistency and the readability of the paper.

References

  1. 1.
    Burke, J., Lewis, A., Overton, M.: A robust gradient sampling algorithm for nonsmooth nonconvex optimization. SIAM J. Optim. 15(3), 751–779 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Clarke, F.: Optimization and Nonsmooth Analysis. SIAM, Philadelphia (1990)CrossRefzbMATHGoogle Scholar
  3. 3.
    de Oliveira, W., Sagastizábal, C.: Bundle methods in the XXIst century: a birds’-eye view. Pesqui. Oper. 34(3), 647–670 (2014)CrossRefGoogle Scholar
  4. 4.
    Griewank, A.: On stable piecewise linearization and generalized algorithmic differentiation. Optim. Methods Softw. 28(6), 1139–1178 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Griewank, A., Bernt, J.U., Radons, M., Streubel, T.: Solving piecewise linear systems in abs-normal form. Linear Algebra Appl. 471, 500–530 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. SIAM, Philadelphia (2008)CrossRefzbMATHGoogle Scholar
  7. 7.
    Griewank, A., Walther, A.: First and second order optimality conditions for piecewise smooth objective functions. Optim. Methods Softw. 31(5), 904–930 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Griewank, A., Walther, A., Fiege, S., Bosse, T.: On Lipschitz optimization based on gray-box piecewise linearization. Math. Program. Ser. A 158, 383–415 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Gurbuzbalaban, M., Overton, M.L.: On Nesterov’s nonsmooth Chebyshev–Rosenbrock functions. Nonlinear Anal. Theory Methods Appl. 75(3), 1282–1289 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Haarala, M., Miettinen, K., Mäkelä, M.: New limited memory bundle method for large-scale nonsmooth optimization. Optim. Methods Softw. 19(6), 673–692 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Hiriart-Urruty, J.B., Lemaréchal, C.: Convex Analysis and Minimization Algorithms I. Springer, Berlin (1993)CrossRefzbMATHGoogle Scholar
  12. 12.
    Karmitsa, N., Mäkelä, M.: Limited memory bundle method for large bound constrained nonsmooth optimization: convergence analysis. Optim. Methods Softw. 25(6), 895–916 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Lemaréchal, C., Sagastizábal, C.: Variable metric bundle methods: from conceptual to implementable forms. Math. Program. 76(3), 393–410 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Lewis, A., Overton, M.: Nonsmooth optimization via quasi-Newton methods. Math. Program. 141(1–2), 135–163 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Lukšan, L., Vlček, J.: Test problems for nonsmooth unconstrained and linearly constrained optimization. Technical report 798, Institute of Computer Science, Academy of Sciences of the Czech Republic (2000)Google Scholar
  16. 16.
    Mäkelä, M., Neittaanmäki, P.: Nonsmooth Optimization: Analysis and Algorithms with Applications to Optimal Control. World Scientific Publishing Co., Singapore (1992)CrossRefzbMATHGoogle Scholar
  17. 17.
    Mäkelä, M.M.: Multiobjective proximal bundle method for nonconvex nonsmooth optimization: Fortran subroutine MPBNGC 2.0. Reports of the Department of Mathematical Information Technology, Series B, Scientific computing No. B 13/2003, University of Jyväskylä (2003)Google Scholar
  18. 18.
    Nesterov, Y.: Lexicographic differentiation of nonsmooth functions. Math. Program. 104(2–3), 669–700 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Scholtes, S.: Introduction to Piecewise Differentiable Functions. Springer, Berlin (2012)CrossRefzbMATHGoogle Scholar
  20. 20.
    Shor, N.: Nondifferentiable Optimization and Polynomial Problems. Kluwer, Amsterdam (1998)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature and Mathematical Optimization Society 2018

Authors and Affiliations

  1. 1.Department of MathematicsPaderborn UniversityPaderbornGermany
  2. 2.School of Mathematical Science and Information TechnologyYachaytechUrcuquiEcuador

Personalised recommendations

Cite article

Buy options