Structural and Multidisciplinary Optimization

, Volume 58, Issue 3, pp 1291–1295 | Cite as

Alternating direction method of multipliers as a simple effective heuristic for mixed-integer nonlinear optimization

  • Yoshihiro Kanno
  • Satoshi Kitayama


In this paper we propose to utilize a variation of the alternating direction method of multipliers (ADMM) as a simple heuristic for mixed-integer nonlinear optimization problems in structural optimization. Numerical experiments suggest that using multiple restarts of ADMM with random initial points often yields a reasonable solution with small computational cost.


Mixed-integer nonlinear optimization Nonconvex optimization Heuristic Alternating direction method of multipliers 



The work of the first author is partially supported by JSPS KAKENHI 17K06633.


  1. Ames BPW, Hong M (2016) Alternating direction method of multipliers for penalized zero-variance discriminant analysis. Comput Optim Appl 64:725–754MathSciNetCrossRefzbMATHGoogle Scholar
  2. Belotti P, Kirches C, Leyffer S, Linderoth J, Luedtke J, Mahajan A (2013) Mixed-integer nonlinear optimization. Acta Numerica 22:1–131MathSciNetCrossRefzbMATHGoogle Scholar
  3. Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2010) Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning 3:1–122CrossRefzbMATHGoogle Scholar
  4. Cai J, Thierauf G (1993) Discrete optimization of structures using an improved penalty function method. Eng Optim 21:293–306CrossRefGoogle Scholar
  5. Chartrand R, Wohlberg B (2013) A nonconvex ADMM algorithm for group sparsity with sparse groups. In: 2013 IEEE international conference on acoustics, speech and signal processing, Vancouver, pp 6009–6013Google Scholar
  6. D’Ambrosio C, Frangioni A, Liberti L, Lodi A (2012) A storm of feasibility pumps for nonconvex MINLP. Math Program, Series B 136:375–402MathSciNetCrossRefzbMATHGoogle Scholar
  7. Diamond S, Takapoui R, Boyd S (2018) A general system for heuristic minimization of convex functions over non-convex sets. Optimization Methods and Software 33:165–193MathSciNetCrossRefzbMATHGoogle Scholar
  8. Geißler B, Morsi A, Schewe L, Schmidt M (2017) Penalty alternating direction methods for mixed-integer optimization: a new view on feasibility pumps. SIAM J Optim 27:1611–1636MathSciNetCrossRefzbMATHGoogle Scholar
  9. Groenwold AA, Stander N, Snyman JA (1999) A regional genetic algorithm for the discrete optimal design of truss structures. Int J Numer Methods Eng 44:749–766CrossRefzbMATHGoogle Scholar
  10. He S, Prempain E, Wu QH (2004) An improved particle swarm optimizer for mechanical design optimization problems. Eng Optim 36:585–605MathSciNetCrossRefGoogle Scholar
  11. IBM Knowledge Center (2017) IBM ILOG CPLEX Optimization Studio Documentation. (Accessed October 2017)
  12. Juang DS, Chang WT (2006) A revised discrete Lagrangian-based search algorithm for the optimal design of skeletal structures using available sections. Struct Multidiscip Optim 31:201–210CrossRefGoogle Scholar
  13. Kanno Y (2016) Mixed-integer second-order cone programming for global optimization of compliance of frame structure with discrete design variables. Struct Multidiscip Optim 54:301–316MathSciNetCrossRefGoogle Scholar
  14. Kanno Y, Fujita S (to appear) Alternating direction method of multipliers for truss topology optimization with limited number of nodes: A cardinality-constrained second-order cone programming approach. Optim Eng.
  15. Kitayama S, Arakawa M, Yamazaki K (2006) Penalty function approach for the mixed discrete nonlinear problems by particle swarm optimization. Struct Multidiscip Optim 32:191–202MathSciNetCrossRefzbMATHGoogle Scholar
  16. Kitayama S, Arakawa M, Yamazaki K (2012) Discrete differential evolution for mixed discrete non-linear problems. Journal of Civil Engineering and Architecture 6:594–605Google Scholar
  17. Lee K-M, Tsai J-T, Liu T-K, Chou J-H (2010) Improved genetic algorithm for mixed-discrete-continuous design optimization problems. Eng Optim 42:927–941CrossRefGoogle Scholar
  18. Li H-L, Chou C-T (1994) A global approach for nonlinear mixed discrete programming in design optimization. Eng Optim 22:109–122CrossRefGoogle Scholar
  19. Lu YC, Jan JC, Hung SL, Hung GH (2013) Enhancing particle swarm optimization algorithm using two new strategies for optimizing design of truss structures. Eng Optim 45:1251–1271CrossRefGoogle Scholar
  20. Munk DJ, Vio GA, Steven GP (2015) Topology and shape optimization methods using evolutionary algorithms: a review. Struct Multidiscip Optim 52:613–631MathSciNetCrossRefGoogle Scholar
  21. Rao SS (1996) Engineering optimization: theory and practice. Wiley, New YorkGoogle Scholar
  22. Rasmussen MH, Stolpe M (2008) Global optimization of discrete truss topology design problems using a parallel cut-and-branch method. Comput Struct 86:1527–1538CrossRefGoogle Scholar
  23. Sørensen SN, Stolpe M (2015) Global blending optimization of laminated composites with discrete material candidate selection and thickness variation. Struct Multidiscip Optim 52:137–155MathSciNetCrossRefGoogle Scholar
  24. Sandgren E (1990) Nonlinear integer and discrete programming in mechanical design optimization. J Mech Des 112:223–229CrossRefGoogle Scholar
  25. Takapoui R, Moehle N, Boyd S, Bemporad A (to appear) A simple effective heuristic for embedded mixed-integer quadratic programming. Int J Control.
  26. The MathWorks Inc. (2017) MATLAB documentation. (Accessed October 2017
  27. Thierauf G, Cai J (1998) Parallelization of the evolution strategy for discrete structural optimization problems. Comput Aided Civ Inf Eng 13:23–30CrossRefGoogle Scholar
  28. Zavala GR, Nebro AJ, Luna F, Coello Coello CA (2014) A survey of multi-objective metaheuristics applied to structural optimization. Struct Multidiscip Optim 49:537–558MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Mathematics and Informatics CenterThe University of TokyoTokyoJapan
  2. 2.Faculty of Mechanical Engineering, Institute of Science and EngineeringKanazawa UniversityKakuma-machiJapan

Personalised recommendations