Abstract
This paper presents an empirical study of the convergence characteristics of augmented Lagrangian coordination (ALC) for solving multi-modal optimization problems in a distributed fashion. A number of test problems that do not satisfy all assumptions of the convergence proof for ALC are selected to demonstrate the convergence characteristics of ALC algorithms. When only a local search is employed at the subproblems, local solutions to the original problem are often attained. When a global search is performed at subproblems, global solutions to the original, non-decomposed problem are found for many of the examples. Although these findings are promising, ALC with a global subproblem search may yield only local solutions in the case of non-convex coupling functions or disconnected feasible domains. Results indicate that for these examples both the starting point and the sequence in which subproblems are solved determines which solution is obtained. We illustrate that the main cause for this behavior lies in the alternating minimization inner loop, which is inherently of a local nature.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Alexandrov NM, Lewis RM (2002) Analytical and computational aspects of collaborative optimization for multidisciplinary design. AIAA J 40(2):301–309
Allison JT, Papalambros PY (2008) Consistency constraint allocation in augmented lagrangian coordination. In: Proceedings of the ASME design engineering technical conferences, Brooklyn, New York, 3–6 August 2008
Arora JS, Chahande AI, Paeng JK (1991) Multiplier methods for engineering optimization. Int J Numer Methods Eng 32(7):1485–1525
Arslan MA, Hajela P (1997) Counterpropagation neural networks in decomposition based optimal design. Comput Struct 65(5):641–650
Balling RJ, Sobieszczanski-Sobieski J (1996) Optimization of coupled systems: a critical overview of approaches. AIAA J 34(1):6–17
Bertsekas DP (1982) Constrained optimization and lagrange multiplier methods. Academic, New York
Bertsekas DP (2003) Nonlinear programming, 2nd edn, 2nd printing. Athena Scientific, Belmont
Bertsekas DP, Tsitsiklis JN (1989) Parallel and distributed computation. Prentice-Hall, Englewood Cliffs
Bezdek JC, Hathaway R (2002) Some notes on alternating optimization. Lect Notes Comput Sci 2275:288–300
Blouin VY, Lassiter JB, Wiecek MM, Fadel GM (2005) Augmented Lagrangian coordination for decomposed design problems. In: Proceedings of the 6th world congress on structural and multidisciplinary optimization, Rio de Janeiro, 30 May–3 June 2005
Braun RD (1996) Collaborative optimization: an architecture for large-scale distributed design. PhD thesis, Stanford University
Braun RD, Moore AA, Kroo IM (1997) Collaborative approach to launch vehicle design. J Spacecr Rockets 34(4):478–486
Cramer EJ, Dennis JE, Frank PD, Lewis RM, Shubin GR (1994) Problem formulation for multidisciplinary optimization. SIAM J Optim 4(4):754–776
Deb K (2000) An efficient constraint handling method for genetic algorithms. Comput Methods Appl Mech Eng 186(2-4):311–338
DeMiguel AV, Murray W (2000) An analysis of collaborative optimization methods. In: Proceedings of the 8th AIAA/USAF/NASA/ISSMO symposium on multidisciplinary analysis and optimization, AIAA paper 2000-4720, Long Beach, 6–8 September 2000
DeMiguel AV, Murray W (2006) A local convergence analysis of bilevel decomposition algorithms. Optim Eng 7(2):99–133
Fortin M, Glowinski R (1983) Augmented Lagrangian methods: application to the numerical solution of boundary-value problems. North-Holland, Amsterdam
Gill PE, Murray W, Wright MH (1981) Practical optimization. Academic, London
Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear Gauss-Seidel method under convex constraints. Oper Res Lett 26(3):127–136
Haftka RT, Gürdal Z (1993) Elements of structural optimization, 3rd edn. Kluwer Academic, Dordrecht
Haftka RT, Watson LT (2005) Multidisciplinary design optimization with quasiseparable subsystems. Optim Eng 6(1):9–20
Kim HM (2001) Target cascading in optimal system design. PhD thesis, University of Michigan
Kim HM, Papalambros PY (2006) Target exploration for disconnected feasible regions in enterprise-driven multilevel product design. AIAA J 44(1):67–77
Kim HM, Michelena NF, Papalambros PY, Jiang T (2003) Target cascading in optimal system design. ASME J Mech Des 125(3):474–480
LGO Solver Suite (2008) Pintér consulting. http://www.pinterconsulting.com. Accessed 30 June 2008
Li Y, Lu Z, Michalek JJ (2008) Diagonal quadratic approximation for parallelization of analytical target cascading. ASME J Mech Des 31(5):1–11
Lin J (2004) Analysis and enhancement of collaborative optimization for multidisciplinary design. AIAA J 42(2):348–360
Liu B, Haftka RT, Watson LT (2004) Global-local structural optimization using response surfaces of local optimization margins. Struct Multidiscipl Optim 27(5):352–359
Mathworks (2008) Matlab user guide, Version 7. Mathworks, Natick
Michelena N, Kim HM, Papalambros PY (1999) A system partitioning and optimization approach to target cascading. In: Proceedings of the 12th international conference on engineering design, Munich, 24–26 August 1999
Michelena NF, Park H, Papalambros PY (2003) Convergence properties of analytical target cascading. AIAA J 41(5):897–905
Roth BD, Kroo IM (2008) Enhanced collaborative optimization: a decomposition-based method for multidisciplinary design. In: Proceedings of the ASME design engineering technical conferences, Brooklyn, New York, 3–6 August 2008
Schutte JF, Haftka RT, Watson LT (2004) Decomposition and two-level optimization of structures with discrete sizing variables. In: Proceedings of the 45th AIAA/ASME/ASCE-AHS/ASC structures, structural dynamics, and materials conference, AIAA paper 2004-1541, Palm Springs, 19–22 April 2004
Shin MK, Park GJ (2005) Multidisciplinary design optimization based on independent subspaces. Int J Numer Methods Eng 64(5):599–617
Sobieski IP, Kroo I (2000) Collaborative optimization using response surface estimation. AIAA J 38(10):1931–1938
Sobieszczanski-Sobieski J (1988) Optimization by decomposition: A step from hierarchic to non-hierarchic systems. In: Proceedings of the 2nd NASA air force symposium on advances in multidisciplinary analysis and optimization, NASA CP-3031, Hampton, September 1988
Sobieszczanski-Sobieski J, James BB, Dovi AR (1985) Structural and multidisciplinary optimization by multilevel decomposition. AIAA J 23(11):1775–1782
Sobieszczanski-Sobieski J, Agte JS, Sandusky Jr RR (2000) Bilevel integrated system synthesis. AIAA J 38(1):164–172
Sobieszczanski-Sobieski J, Altus TD, Phillips M, Sandusky Jr RR (2003) Bilevel integrated system synthesis for concurrent and distributed processing. AIAA J 41(10):1996–2003
Tosserams S, Etman LFP, Papalambros PY, Rooda JE (2006) An augmented Lagrangian relaxation for analytical target cascading using the alternating direction method of multipliers. Struct Multidiscipl Optim 31(3):176–189
Tosserams S, Etman LFP, Rooda JE (2007) An augmented Lagrangian decomposition method for quasi-separable problems in MDO. Struct Multidiscipl Optim 34(3):211–227
Tosserams S, Etman LFP, Rooda JE (2008) Augmented Lagrangian coordination for distributed optimal design in MDO. Int J Numer Methods Eng 73(13):1885–1910
Tosserams S, Etman LFP, Rooda JE (2009a) Block-separable linking constraints in augmented Lagrangian coordination. Struct Multidiscipl Optim 37(5):521–527
Tosserams S, Etman LFP, Rooda JE (2009b) A classification of methods for distributed system optimization based on formulation structure. Struct Multidiscipl Optim doi:10.1007/s00158-008-0347-z
Vanderplaats GN, Yang YJ, Kim DS (1990) Sequential linearization method for multilevel optimization. AIAA J 28(2):290–295
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is funded by MicroNed, grant number 10005898.
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Tosserams, S., Etman, L.F.P. & Rooda, J.E. Multi-modality in augmented Lagrangian coordination for distributed optimal design. Struct Multidisc Optim 40, 329–352 (2010). https://doi.org/10.1007/s00158-009-0371-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-009-0371-7