Abstract
We study optimistic bilevel optimization problems, where we assume the lower-level problem is convex with a nonempty, compact feasible region and satisfies a constraint qualification for all possible upper-level decisions. Replacing the lower-level optimization problem by its first-order conditions results in a mathematical program with equilibrium constraints (MPEC) that needs to be solved. We review the relationship between the MPEC and bilevel optimization problem and then survey the theory, algorithms, and software environments for solving the MPEC formulations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
S.M. Alizadeh, P. Marcotte, G. Savard, Two-stage stochastic bilevel programming over a transportation network. Transp. Res. Part B: Methodol. 58, 92–105 (2013)
G.B. Allende, G. Still, Solving bilevel programs with the KKT-approach. Math. Program. 138(1), 309–332 (2013)
M. Anitescu, On solving mathematical programs with complementarity constraints as nonlinear programs. Preprint ANL/MCS-P864-1200, Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL (2000)
M. Anitescu, Global convergence of an elastic mode approach for a class of mathematical programs with complementarity constraints. Preprint ANL/MCS-P1143–0404, Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL (2004)
M. Anitescu, On using the elastic mode in nonlinear programming approaches to mathematical programs with complementarity constraints. SIAM J. Optim. 15(4), 1203–1236 (2005)
M. Anitescu, P. Tseng, S.J. Wright, Elastic-mode algorithms for mathematical programs with equilibrium constraints: global convergence and stationarity properties. Math. Program. 110(2), 337–371 (2007)
Artelys, Artelys KNITRO user’s manual. Available at https://www.artelys.com/docs/knitro/index.html
L. Bai, J.E. Mitchell, J.-S. Pang, On convex quadratic programs with linear complementarity constraints. Comput. Optim. Appl. 54(3), 517–554 (2013)
J.F. Bard, Convex two-level optimization. Math. Program. 40(1), 15–27 (1988)
J.F. Bard, Practical Bilevel Optimization: Algorithms and Applications, vol. 30 (Kluwer Academic Publishers, Dordrecht, 1998)
J.F. Bard, J.T. Moore, A branch and bound algorithm for the bilevel programming problem. SIAM J. Sci. Stat. Comput. 11(2), 281–292 (1990)
P. Belotti, J. Lee, L. Liberti, F. Margot, A. Wächter, Branching and bounds tightening techniques for non-convex MINLP. Optim. Methods Softw. 24(4–5), 597–634 (2009)
A. Ben-Tal, L. El Ghaoui, A. Nemirovski, Robust Optimization (Princeton University Press, Princeton, 2009)
J.F. Benders, Partitioning procedures for solving mixed-variable programming problems. Numerische Mathematik 4, 238–252 (1962)
H. Benson, A. Sen, D.F. Shanno, R. Vanderbei, Interior-point algorithms, penalty methods and equilibrium problems. Comput. Optim. Appl. 34(2), 155–182 (2006)
R.H. Byrd, J. Nocedal, R.A. Waltz, Knitro: an integrated package for nonlinear optimization, in Large-Scale Nonlinear Optimization (Springer, New York, 2006), pp. 35–59
R.H. Byrd, J. Nocedal, R.A. Waltz, Steering exact penalty methods for nonlinear programming. Optim. Methods Softw. 23(2), 197–213 (2008)
X. Chi, Z. Wan, Z. Hao, The models of bilevel programming with lower level second-order cone programs. J. Inequal. Appl. 2014(1), 168 (2014)
X. Chi, Z. Wan, Z. Hao, Second order sufficient conditions for a class of bilevel programs with lower level second-order cone programming problem. J. Ind. Manage. Optim. 11(4), 1111–1125 (2015)
N.H. Chieu, G.M. Lee, Constraint qualifications for mathematical programs with equilibrium constraints and their local preservation property. J. Optim. Theory Appl. 163(3), 755–776 (2014)
C.M. Chin, R. Fletcher, On the global convergence of an SLP-filter algorithm that takes EQP steps. Math. Program. 96(1), 161–177 (2003)
S. Christiansen, M. Patriksson, L. Wynter, Stochastic bilevel programming in structural optimization. Struct. Multidiscipl. Optim. 21(5), 361–371 (2001)
F.H. Clarke, A new approach to Lagrange multipliers. Math. Oper. Res. 1(2), 165–174 (1976)
B. Colson, P. Marcotte, G. Savard, Bilevel programming: a survey. 4OR 3(2), 87–107 (2005)
F.F. Dedzo, L.P. Fotso, C.O. Pieume, Solution concepts and new optimality conditions in bilevel multiobjective programming. Appl. Math. 3(10), 1395 (2012)
V. DeMiguel, M.P. Friedlander, F.J. Nogales, S. Scholtes, A two-sided relaxation scheme for mathematical programs with equilibrium constraints. SIAM J. Optim. 16(2), 587–609 (2005)
S. Dempe, Foundations of Bilevel Programming (Springer Science & Business Media, New York, 2002)
S. Dempe, Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints. Optimization 52, 333–359 (2003)
S. Dempe, Bilevel Optimization: Theory, Algorithms and Applications (TU Bergakademie Freiberg, Fakultät für Mathematik und Informatik, 2018)
S. Dempe, J. Dutta, Is bilevel programming a special case of a mathematical program with complementarity constraints? Math. Program. 131(1–2), 37–48 (2012)
S. Dempe, S. Franke, On the solution of convex bilevel optimization problems. Comput. Optim. Appl. 63(3), 685–703 (2016)
S. Dempe, A.B. Zemkoho, The bilevel programming problem: reformulations, constraint qualifications and optimality conditions. Math. Program. 138(1), 447–473 (2013)
S. Dempe, A.B. Zemkoho, KKT reformulation and necessary conditions for optimality in nonsmooth bilevel optimization. SIAM J. Optim. 24(4), 1639–1669 (2014)
S. Dempe, B.S. Mordukhovich, A.B. Zemkoho, Necessary optimality conditions in pessimistic bilevel programming. Optimization 63(4), 505–533 (2014)
S. Dempe, G. Luo, S. Franke, Pessimistic Bilevel Linear Optimization (Technische Universität Bergakademie Freiberg, Fakultät für Mathematik und Informatik, 2016)
S. Dempe, F. Mefo Kue, P. Mehlitz, Optimality conditions for mixed discrete bilevel optimization problems. Optimization 67(6), 737–756 (2018)
M. Diehl, B. Houska, O. Stein, P. Steuermann, A lifting method for generalized semi-infinite programs based on lower level Wolfe duality. Comput. Optim. Appl. 54(1), 189–210 (2013)
S.P. Dirkse, MPEC world, 2001. Available at http://www.gamsworld.org/mpec/mpeclib.htm
G. Eichfelder, Multiobjective bilevel optimization. Math. Program. 123(2), 419–449 (2010)
H.-R. Fang, S. Leyffer, T. Munson, A pivoting algorithm for linear programming with linear complementarity constraints. Optim. Methods Softw. 27(1), 89–114 (2012)
M.C. Ferris, F. Tin-Loi, On the solution of a minimum weight elastoplastic problem involving displacement and complementarity constraints. Comput. Methods Appl. Mech. Eng. 174, 107–120 (1999)
M.L. Flegel, C. Kanzow, Abadie-type constraint qualification for mathematical programs with equilibrium constraints. J. Optim. Theory Appl. 124(3), 595–614 (2005)
M.L. Flegel, C. Kanzow, A direct proof of M-stationarity under MPEC-GCQ for mathematical programs with equilibrium constraints, in Optimization with Multivalued Mappings: Theory, Applications, and Algorithms, ed. by S. Dempe, V. Kalashnikov (Springer, New York, 2006), pp. 111–122
R. Fletcher, S. Leyffer, FilterMPEC. Available at https://neos-server.org/neos/solvers/cp:filterMPEC/AMPL.html
R. Fletcher, S. Leyffer, Numerical experience with solving MPECs as NLPs. Numerical Analysis Report NA/210, Department of Mathematics, University of Dundee, Dundee, 2002
R. Fletcher, S. Leyffer, Solving mathematical program with complementarity constraints as nonlinear programs. Optim. Methods Softw. 19(1), 15–40 (2004)
R. Fletcher, E. Sainz de la Maza, Nonlinear programming and nonsmooth optimization by successive linear programming. Math. Program. 43, 235–256 (1989)
R. Fletcher, S. Leyffer, D. Ralph, S. Scholtes, Local convergence of SQP methods for mathematical programs with equilibrium constraints. SIAM J. Optim. 17(1), 259–286 (2006)
C. Floudas, O. Stein, The adaptive convexification algorithm: a feasible point method for semi-infinite programming. SIAM J. Optim. 18(4), 1187–1208 (2008)
R. Fourer, D.M. Gay, B.W. Kernighan, AMPL: a modeling language for mathematical programming, 2003. Available at https://ampl.com/resources/the-ampl-book/chapter-downloads
M. Fukushima, G.-H. Lin, Smoothing methods for mathematical programs with equilibrium constraints, in International Conference on Informatics Research for Development of Knowledge Society Infrastructure, 2004. ICKS 2004. (IEEE, New York, 2004), pp. 206–213
M. Fukushima, P. Tseng, An implementable active-set algorithm for computing a B-stationary point of the mathematical program with linear complementarity constraints. SIAM J. Optim. 12, 724–739 (2002)
GAMS Development Corporation, Bilevel programming using GAMS/EMP. Available at https://www.gams.com/latest/docs/UG_EMP_Bilevel.html
GAMS Development Corporation, The GAMS EMP library. Available at https://www.gams.com/latest/emplib_ml/libhtml/index.html
GAMS Development Corporation, NLPEC (Nonlinear programming with equilibrium constraints). Available at https://www.gams.com/latest/docs/S_NLPEC.html
H. Gfrerer, Optimality conditions for disjunctive programs based on generalized differentiation with application to mathematical programs with equilibrium constraints. SIAM J. Optim. 24(2), 898–931 (2014)
G. Giallombardo, D. Ralph, Multiplier convergence in trust-region methods with application to convergence of decomposition methods for MPECs. Math. Program. 112(2), 335–369 (2008)
P.E. Gill, W. Murray, M.A. Saunders, SNOPT: an SQP algorithm for large-scale constrained optimization. SIAM J. Optim. 12(4), 979–1006 (2002)
P.E. Gill, W. Murray, M.A. Saunders, SNOPT: an SQP algorithm for large-scale constrained optimization. SIAM Rev. 47(1), 99–131 (2005)
P. Hansen, B. Jaumard, G. Savard, New branch-and-bound rules for linear bilevel programming. SIAM J. Sci. Stat. Comput. 13(5), 1194–1217 (1992)
W. Hart, J.D. Siirola, Modeling mathematical programs with equilibrium constraints in Pyomo. Technical report, Sandia National Laboratories, Albuquerque, NM, 2015
W. Hart, R. Chen, J.D. Siirola, J.-P. Watson, Modeling bilevel programs in Pyomo. Technical report, Sandia National Laboratories, Albuquerque, NM, 2016
M. Hintermüller, T. Surowiec, A bundle-free implicit programming approach for a class of elliptic MPECs in function space. Math. Program. 160(1), 271–305 (2016)
T. Hoheisel, C. Kanzow, A. Schwartz, Theoretical and numerical comparison of relaxation methods for mathematical programs with complementarity constraints. Math. Program. 137(1), 257–288 (2013)
J.N. Hooker, G. Ottosson, Logic-based Benders decomposition. Math. Program. 96(1), 33–60 (2003)
X. Hu, D. Ralph, Convergence of a penalty method for mathematical programming with complementarity constraints. J. Optim. Theory Appl. 123(2), 365–390 (2004)
J. Hu, J. Mitchell, J.-S. Pang, K. Bennett, G. Kunapuli, On the global solution of linear programs with linear complementarity constraints. SIAM J. Optim. 19(1), 445–471 (2008)
J. Hu, J. Mitchell, J.-S. Pang, B. Yu, On linear programs with linear complementarity constraints. J. Glob. Optim. 53(1), 29–51 (2012)
A.F. Izmailov, M.V. Solodov, E.I. Uskov, Global convergence of augmented lagrangian methods applied to optimization problems with degenerate constraints, including problems with complementarity constraints. SIAM J. Optim. 22(4), 1579–1606 (2012)
F. Jara-Moroni, J.-S. Pang, A. Wächter, A study of the difference-of-convex approach for solving linear programs with complementarity constraints. Math. Program. 169(1), 221–254 (2018)
H. Jiang, D. Ralph, QPECgen, a MATLAB generator for mathematical programs with quadratic objectives and affine variational inequality constraints. Comput. Optim. Appl. 13, 25–59 (1999)
K.L. Judd, C.-L. Su, Computation of moral-hazard problems, in Society for Computational Economics, Computing in Economics and Finance, 2005
C. Kanzow, A. Schwartz, Convergence properties of the inexact Lin-Fukushima relaxation method for mathematical programs with complementarity constraints. Comput. Optim. Appl. 59(1), 249–262 (2014)
C. Kanzow, A. Schwartz, The price of inexactness: convergence properties of relaxation methods for mathematical programs with complementarity constraints revisited. Math. Oper. Res. 40(2), 253–275 (2015)
P.-M. Kleniati, C.S. Adjiman, Branch-and-sandwich: a deterministic global optimization algorithm for optimistic bilevel programming problems. Part I: Theoretical development. J. Global Optim. 60(3), 425–458 (2014)
P.-M. Kleniati, C.S. Adjiman, Branch-and-sandwich: a deterministic global optimization algorithm for optimistic bilevel programming problems. Part II: Convergence analysis and numerical results. J. Global Optim. 60(3), 459–481 (2014)
M. Kojima, Strongly stable stationary solutions in nonlinear programming, in Analysis and Computation of Fixed Points, ed. by S.M. Robinson, pp. 93–138 (Academic, New York, 1980)
C.D. Kolstad, A review of the literature on bi-level mathematical programming. Technical report, Los Alamos National Laboratory Los Alamos, NM, 1985
C. Kwon, Complementarity package for Julia/JuMP. Available at https://github.com/chkwon/Complementarity.jl
K. Lachhwani, A. Dwivedi, Bi-level and multi-level programming problems: taxonomy of literature review and research issues. Arch. Comput. Methods Eng. 25(4), 847–877 (2018)
S. Leyffer, MacMPEC: AMPL collection of MPECs, 2000. Available at https://wiki.mcs.anl.gov/leyffer/index.php/MacMPEC
S. Leyffer, Mathematical programs with complementarity constraints. SIAG/OPT Views-and-News 14(1), 15–18 (2003)
S. Leyffer, Complementarity constraints as nonlinear equations: theory and numerical experience, in emphOptimization and Multivalued Mappings, ed. by S. Dempe, V. Kalashnikov (Springer, Berlin, 2006), pp. 169–208
S. Leyffer, T. Munson, A globally convergent filter method for MPECs. Preprint ANL/MCS-P1457-0907, Argonne National Laboratory, Mathematics and Computer Science Division, 2007
S. Leyffer, G. Lopez-Calva, J. Nocedal, Interior methods for mathematical programs with complementarity constraints. SIAM J. Optim. 17(1), 52–77 (2006)
G. Li, Z. Wan, J.-W. Chen, X. Zhao, Necessary optimality condition for trilevel optimization problem. J. Ind. Manage. Optim. 41, 282–290 (2018)
X. Liu, J. Sun, Generalized stationary points and an interior-point method for mathematical programs with equilibrium constraints. Math. Program. 101(1), 231–261 (2004).
X. Liu, G. Perakis, J. Sun, A robust SQP method for mathematical programs with linear complementarity constraints. Comput. Optim. Appl. 34, 5–33 (2006)
J. Liu, Y. Fan, Z. Chen, Y. Zheng, Pessimistic bilevel optimization: a survey. Int. J. Comput. Intell. Syst. 11(1), 725–736 (2018)
Z.-Q. Luo, J.-S. Pang, D. Ralph, Mathematical Programs with Equilibrium Constraints (Cambridge University Press, Cambridge, 1996)
Y. Lv, Z. Wan, Solving linear bilevel multiobjective programming problem via exact penalty function approach. J. Inequal. Appl. 2015(1), 258 (2015)
A. Migdalas, P.M. Pardalos, P. Värbrand (eds.) Multilevel Optimization: Algorithms and Applications (Kluwer Academic Publishers, Dordrecht, 1997)
J.A. Mirrlees, The theory of moral hazard and unobservable behaviour: part I. Rev. Econ. Stud. 66(1), 3–21 (1999)
A. Mitsos, P. Lemonidis, P.I. Barton, Global solution of bilevel programs with a nonconvex inner program. J. Global Optim. 42(4), 475–513 (2008)
A. Mitsos, P. Lemonidis, C. Lee, P.I. Barton, Relaxation-based bounds for semi-infinite programs. SIAM J. Optim. 19(1), 77–113 (2008)
J.T. Moore, J.F. Bard, The mixed integer linear bilevel programming problem. Oper. Res. 38(5), 911–921 (1990)
J.V. Outrata, Optimality conditions for a class of mathematical programs with equilibrium constraints. Math. Oper. Res. 24(3), 627–644 (1999)
J.V. Outrata, M. Kočvara, J. Zowe, Nonsmooth Approach to Optimization Problems with Equilibrium Constraints (Kluwer Academic Publishers, Dordrecht, 1998)
J.-S. Pang, Three modeling paradigms in mathematical programming. Math. Program. 125(2), 297–323 (2010)
C.O. Pieume, P. Marcotte, L.P. Fotso, P. Siarry, Solving bilevel linear multiobjective programming problems. Am. J. Oper. Res. 1(4), 214–219 (2011)
E.S. Prescott, A primer on moral-hazard models. Feder. Reserve Bank Richmond Q. Rev. 85, 47–77 (1999)
L. Qi, Z. Wei, On the constant positive linear dependence condition and its application to SQP methods. SIAM J. Optim. 10(4), 963–981 (2000)
A. Raghunathan, L.T. Biegler, An interior point method for mathematical programs with complementarity constraints (MPCCs). SIAM J. Optim. 15(3), 720–750 (2005)
D. Ralph, S.J. Wright, Some properties of regularization and penalization schemes for MPECs. Optim. Methods Softw. 19(5), 527–556 (2004)
S.M. Robinson, Strongly regular generalized equations. Math. Oper. Res. 5(1), 43–62 (1980)
M. Roelofs, J. Bisschop, The AIMMS language reference. Available at https://aimms.com/english/developers/resources/manuals/language-reference
N.V. Sahinidis, BARON 17.8.9: Global Optimization of Mixed-Integer Nonlinear Programs, User’s Manual, 2017
H. Scheel, S. Scholtes, Mathematical program with complementarity constraints: stationarity, optimality and sensitivity. Math. Oper. Res. 25, 1–22 (2000)
S. Scholtes, Convergence properties of a regularization schemes for mathematical programs with complementarity constraints. SIAM J. Optim. 11(4), 918–936 (2001)
S. Scholtes, Nonconvex structures in nonlinear programming. Oper. Res. 52(3), 368–383 (2004)
K. Shimizu, Y. Ishizuka, J.F. Bard, Nondifferentiable and Two-level Mathematical Programming (Kluwer Academic Publishers, Dordrecht, 1997)
O. Stein, Bi-Level Strategies in Semi-Infinite Programming, vol. 71 (Springer Science and Business Media, New York, 2013)
O. Stein, P. Steuermann, The adaptive convexification algorithm for semi-infinite programming with arbitrary index sets. Math. Program. 136(1), 183–207 (2012)
O. Stein, A. Winterfeld, Feasible method for generalized semi-infinite programming. J. Optim. Theory Appl. 146(2), 419–443 (2010)
M. Tawarmalani, N.V. Sahinidis, A polyhedral branch-and-cut approach to global optimization. Math. Program. 103, 225–249 (2005)
L.N. Vicente, P.H. Calamai, Bilevel and multilevel programming: a bibliography review. J. Global Optim. 5(3), 291–306 (1994)
W. Wiesemann, A. Tsoukalas, P.-M. Kleniati, B. Rustem, Pessimistic bilevel optimization. SIAM J. Optim. 23(1), 353–380 (2013)
H. Xu, An implicit programming approach for a class of stochastic mathematical programs with complementarity constraints. SIAM J. Optim. 16(3), 670–696 (2006)
J.J. Ye, J. Zhang, Enhanced Karush-Kuhn-Tucker conditions for mathematical programs with equilibrium constraints. J. Optim. Theory Appl. 163(3), 777–794 (2014)
J.J. Ye, D. Zhu, New necessary optimality conditions for bilevel programs by combining the MPEC and value function approaches. SIAM J. Optim. 20(4), 1885–1905 (2010)
Acknowledgements
This work was supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research under Contract No. DE-AC02-06CH11357 at Argonne National Laboratory.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kim, Y., Leyffer, S., Munson, T. (2020). MPEC Methods for Bilevel Optimization Problems. In: Dempe, S., Zemkoho, A. (eds) Bilevel Optimization. Springer Optimization and Its Applications, vol 161. Springer, Cham. https://doi.org/10.1007/978-3-030-52119-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-52119-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-52118-9
Online ISBN: 978-3-030-52119-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)