Skip to main content

Automatic Directional Differentiation of Nonsmooth Composite Functions

  • Chapter
Recent Developments in Optimization

Part of the book series: Lecture Notes in Economics and Mathematical Systems ((LNE,volume 429))

Abstract

We consider continuous functions that are defined by programs for their evaluation. The basic arithmetic operations and univariate special functions are real analytic in the interior of their domains. However, another frequent ingredient, the absolute value function, has a kink at the origin, which occurs similarly for max and min. A slightly more serious complication arises with the introduction of Euclidean vector norms. It is shown here that the resulting class of composite functions is still directionally real analytic and we develop formulas for propagating the corresponding directional Taylor-coefficients in the forward mode of automatic differentiation. Finally, we discuss possibilities for using the reverse mode to compute generalized gradients.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Christian Bischof, Alan Carle, George Corliss, Andreas Griewank, and Paul Hovland, “ADIFOR: Generating derivative codes from Fortran programs”, Scientific Programming 1(1992) 11–29.

    Google Scholar 

  2. P. Recht D. Pallaschke and R. Urbanski, “On locally Lipschitz quasidifferentiable functions in Banach—space”, Optimization17 (1968) 287–295.

    Google Scholar 

  3. Andreas Griewank, “Computational differentiation and optimization”, in: J. R. Birge and K. G. Murty, eds., Mathematical Programming: State of the Art 199.4( The University of Michigan, Michigan, USA, 1994 ) 102–131.

    Google Scholar 

  4. Andreas Griewank. “Computational differentiation and optimization”, In D. Stewart, H. Gardner and David Singleton, eds., Proceedings of CTAC 1993, Canberra, Australia( World Scientific, Singapore, 1994 ) 37–53.

    Google Scholar 

  5. Andreas Griewank and George Corliss, eds., Automatic Differentiation of Algorithms: Theory, Implementation, and Applications. ( SIAM, Philadelphia, Penn., 1991 ).

    Google Scholar 

  6. Andreas Griewank, David Juedes, and Jean Utke, “ADOL-C, a package for the automatic differentiation of algorithms written in C/C++”, ACM Transactions on Mathematical Software, to appear, 1994. First version submitted in 1991.

    Google Scholar 

  7. Yu. Nesterov, Lexicographical Principals of Differentiation of Nonmmooth Functions, Technical Report, Central Economical & Mathematical Institute, Moscow, CEMI, USSR Academy of Sciences, 1991.

    Google Scholar 

  8. Louis B. Rall, Automatic Differentiation: Techniques and Applications, Lecture Notes in Comput. Sci., 120 ( Springer-Verlag, Berlin, 1981 ).

    Google Scholar 

  9. S. M. Robinson, “Mathematical foundations of nonsmooth embedding methods”, Math. Programming 48 (1990) 221–229.

    Article  Google Scholar 

  10. Stefan Scholtes, Introduction to Piecewise Differentiable Equations, Technical Report, Institut für Statistik und Mathematische Wirtschaftstheorie, Universität Karlsruhe, 1994. Preprint Series: Disskussionsbeiträge.

    Google Scholar 

  11. S. R. Womersley, “Optimality conditions for piecewise smooth functions”, Math. Programming Study 17(1982) 13–27.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Griewank, A. (1995). Automatic Directional Differentiation of Nonsmooth Composite Functions. In: Durier, R., Michelot, C. (eds) Recent Developments in Optimization. Lecture Notes in Economics and Mathematical Systems, vol 429. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-46823-0_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-46823-0_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-60041-1

  • Online ISBN: 978-3-642-46823-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics