Abstract
This paper develops solution strategies for large-scale nonsmooth optimization problems. We transform nonsmooth programs into equivalent mathematical programs with complementarity constraints (MPCCs), and devise NLP-based strategies for their solution. For this purpose, two NLP formulations based on complementarity relaxations are put forward, one of which applies a parameterized formulation and operates with a bounding algorithm, with the aim of taking advantage of the NLP sensitivities in search for the solution; and the other relates closely to the well-studied Lin-Fukushima formulation. Relations between the solutions of these NLPs and of the MPCC is revealed by sensitivity analysis. With appropriate assumptions, the resulting solution of the NLP formulations are proved to be C- and M-stationary for the MPCCs in the limit. Numerical performance of the proposed formulations, and the formulations by Lin & Fukushima and by Scholtes are studied and compared, with selected examples from the MacMPEC collection and two large-scale distillation cases.
Similar content being viewed by others
References
Balakrishna S, Biegler LT (1992) Targetting strategies for the synthesis and heat integration of nonisothermal reactor networks. I EC Res 31(9):2152–2164
Barton PI, Khan KA, Stechlinski P, Watson HAJ (2018) Computationally relevant generalized derivatives: theory, evaluation and applications. Optim Methods Softw 33(4–6):1030–1072
Biegler LT (2010) Nonlinear programming: concepts. Algorithms and applications to chemical processes. SIAM, Philadelphia
Chen B, Harker PT (1993) A non-interior-point continuation method for linear complementarity problems. SIAM J. Matrix Anal Applics. 14(4):1168–1190
Chen C, Mangasarian OL (1995) Smoothing methods for convex inequalities and linear complementarity problems. Math Program 71:51–69
Chen C, Mangasarian OL (1996) A class of smoothing functions for nonlinear and mixed complementarity problems. Comput Optim Appl 5:97–138
Clarke FH (1983) Optimization and Nonsmooth Analysis. Wiley, New York
DeMiguel AV, Friedlander MP, Nogales FJ, Scholtes S (2005) A two-sided relaxation scheme for mathematical programs with equilibrium constraints. SIAM J Opt 16(2):587–609
Dempe S (2002) Foundations of bilevel programming, nonconvex optimization and its applications, vol 61. Kluwer, Dordrecht
Facchinei F, Jiang H, Qi L (1999) A smoothing method for mathematical programs with equilibrium constraints. Math Program 85:107–134
Fiacco A (1983) Introduction to sensitivity and stability analysis in nonlinear programming. Academic Press, New York
Flegel ML, Kanzow C (2006) A direct proof for M-stationarity under MPEC-GCQ for mathematical programs with equilibrium constraints. In: Dempe S, Kalashnikov V (eds) Optimization with multivalued mappings. Springer optimization and its applications, vol 2. Springer, Boston, pp 111–122
Flegel ML, Kanzow C (2003) A Fritz John approach to first order optimality conditions for mathematical programs with equilibrium constraints. Optimization 52(3):277–286
Fukushima M, Pang J-S (1999) Convergence of a smoothing continuation method for mathematical programs with complementarity constraints. In: Théra M, Tichatschke R (eds) Ill-posed variational problems and regularization techniques. Lecture notes in economics and mathematical systems, vol 477. Springer, Berlin, pp 99–110
Griewank A, Walther A (2016) First and second order optimality conditions for piecewise smooth objective functions. Optim Methods Softw 31(5):904–930
Griewank A (2013) On stable piecewise linearization and generalized algorithmic differentiation. Optim Methods Softw 28(6):1139–1178
Guo L, Lin G-H, Ye JJ (2015) Solving mathematical programs with equilibrium constraints. J Optim Theory Appl 166:234–256
Hegerhorst-Schultchen LC, Steinbach MC (2020) On first and second order optimality conditions for abs-Normal NLP. Optimization 69(12):2629–2656
Hegerhorst-Schultchen LC, Kirches C, Steinbach MC (2020) On the relation between MPCCs and optimization problems in abs-normal form. Optim Methods Softw 35(3):560–575
Hegerhorst-Schultchen LC (2020) Optimality conditions for abs-normal NLPs. In: Doctoral dissertation, Fakultät Mathematik und Physik, Universität Hannover
Hoheisel T, Kanzow C, Schwartz A (2013) Theoretical and numerical comparison of relaxation methods for mathematical programs with complementarity constraints. Math Program 137:257–288
Hoheisel T, Kanzow C, Schwartz A (2011) Improved convergence properties of the Lin-Fukushima-Regularization method for mathematical programs with complementarity constraints. Numer Algebra Control Optim 1(1):49–60
Jiang H, Ralph D (2000) Smooth SQP methods for mathematical programs with nonlinear complementarity constraints. SIAM J Opt 10(3):779–808
Kadrani A, Dussault JP, Benchakroun A (2009) A new regularization scheme for mathematical programs with complementarity constraints. SIAM J Opt 20(1):78–103
Kanzow C, Schwartz A (2015) The price of inexactness: convergence properties of relaxation methods for mathematical programs with complementarity constraints revisited. Math Oper Res 40(2):253–275
Kanzow C, Schwartz A (2014) Convergence properties of the inexact Lin-Fukushima relaxation method for mathematical programs with complementarity constraints. Comput Optim Appl 59:249–262
Kanzow C, Schwartz A (2013) A new regularization method for mathematical programs with complementarity constraints with strong convergence properties. SIAM J Opt 23(2):770–798
Khan KA, Barton PI (2015) A vector forward mode of automatic differentiation for generalized derivative evaluation. Optim Methods Softw 30(6):1185–1212
Lang Y-D, Biegler LT (2002) A distributed stream method for tray optimization. AIChE J 48(3):582–595
Leyffer S (2000) MacMPEC: AMPL collection of MPECs, https://wiki.mcs.anl.gov/leyffer/index.php/MacMPEC
Lin G, Fukushima M (2006) Hybrid approach with active set identification for mathematical programs with complementarity constraints. J Optim Theory Appl 128(1):1–28
Lin G, Fukushima M (2005) A modified relaxation scheme for mathematical programs with complementarity constraints. Ann Oper Res 133:63–84
Luo Z-Q, Pang J-S, Ralph D (1996) Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge
Nocedal J, Wright SJ (2006) Numerical Optimization. Springer, New York
Raghunathan A, Biegler LT (2003) Mathematical programs with equilibrium constraints (MPECs) in process engineering. Comput Chem Eng 27(10):1381–1392
Ralph D, Wright SJ (2004) Some properties of regularization and penalization schemes for MPECs. Optim Methods Softw 19(5):527–556
Scheel H, Scholtes S (2000) Mathematical programs with complementarity constraints: stationarity, optimality, and sensitivity. Math Oper Res 25(1):1–22
Scholtes S (2001) Convergence properties of a regularization scheme for mathematical programs with complementary constraints. SIAM J Opt 11(4):918–936
Schwartz A (2018) Mathematical programs with complementarity constraints and related problems. Course Notes, Graduate School CE, Technische Universitatät Darmstadt (https://github.com/alexandrabschwartz/ Winterschool2018/blob/master/LectureNotes.pdf)
Stechlinski P, Khan KA, Barton PI (2018) Generalized sensitivity analysis of nonlinear programs. SIAM J Opt 28(1):272–301
Steffensen S, Ulbrich M (2010) A new regularization scheme for mathematical programs with equilibrium constraints. SIAM J Opt 20(5):2504–2539
Watson HAJ, Khan KA, Barton PI (2015) Multistream heat exchanger modeling and design. AIChE J. 61(10):3390–3403
Acknowledgements
Support for this study was provided from an unrestricted grant from Carrier Corporation, and is gratefully acknowledged. We are also grateful to Dr. Alexandra Schwartz for her great help in MacMPEC/MATLAB interface, and to Dr. Helena Sofia Rodrigues and Dr. M. Teresa T. Monteiro for their kind help in AMPL/MATLAB interface.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, K., Biegler, L.T. MPCC strategies for nonsmooth nonlinear programs. Optim Eng 24, 1883–1929 (2023). https://doi.org/10.1007/s11081-022-09755-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11081-022-09755-y