Abstract
This paper presents a classification of formulations for distributed system optimization based on formulation structure. Two main classes are identified: nested formulations and alternating formulations. Nested formulations are bilevel programming problems where optimization subproblems are nested in the functions of a coordinating master problem. Alternating formulations iterate between solving a master problem and disciplinary subproblems in a sequential scheme. Methods included in the former class are collaborative optimization and BLISS2000. The latter class includes concurrent subspace optimization, analytical target cascading, and augmented Lagrangian coordination. Although the distinction between nested and alternating formulations has not been made in earlier comparisons, it plays a crucial role in the theoretical and computational properties of distributed optimization methods. The most prominent general characteristics for each class are discussed in more detail, providing valuable insights for the theoretical analysis and further development of distributed optimization methods.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Alexandrov NM (2005) Editorial—multidisciplinary design optimization. Optim Eng 6(1):5–7
Alexandrov NM, Lewis RM (1999) Comparative properties of collaborative optimization and other approaches to MDO. In: ASMO UK/ISSMO conference on engineering design optimization. MCB University Press, Bradford, pp 39–46
Alexandrov NM, Lewis RM (2002) Analytical and computational aspects of collaborative optimization for multidisciplinary design. AIAA J 40(2):301–309
Alexandrov NM, Lewis RM (2004a) Reconfigurability in MDO problem synthesis, part 1. In: Proceedings of the 10th AIAA/ISSMO multidisciplinary analysis and optimization conference, AIAA paper 2004-4307, Albany, 30 August–1 September 2004
Alexandrov NM, Lewis RM (2004b) Reconfigurability in MDO problem synthesis, part 2. In: Proceedings of the 10th AIAA/ISSMO multidisciplinary analysis and optimization conference, AIAA paper 2004-4308, Albany, 30 August–1 September 2004
Balling RJ (2002) Decomposition methods in structural optimization. In: Burns SA (ed) Recent advances in optimal structural design. ASCE, Reston
Balling RJ, Sobieszczanski-Sobieski J (1995) An algorithm for solving the system-level problem in multilevel optimization. Struct Optim 9(3–4):168–177
Balling RJ, Sobieszczanski-Sobieski J (1996) Optimization of coupled systems: a critical overview of approaches. AIAA J 34(1):6–17
Balling RJ, Wilkinson CA (1997) Execution of multidisciplinary design optimization approaches on common test problems. AIAA J 35(1):178–186
Beltran C, Heredia FJ (2002) Unit commitment by augmented lagrangian relaxation: testing two decomposition approaches. J Optim Theory Appl 112(2):295–314
Benders JF (1962) Partitioning procedures for solving mixed-variables programming problems. Numer Math 4:238–252
Bertsekas DP (2003) Nonlinear programming, 2nd edn, 2nd printing. Athena Scientific, Belmont
Bertsekas DP, Tsitsiklis JN (1989) Parallel and distributed computation. Prentice-Hall, Englewood Cliffs
Bezdek JC, Hathaway R (2002) Some notes on alternating optimization. Lect Notes Comput Sci 2275:288–300
Bloebaum CL (1992) An intelligent decomposition approach for coupled engineering systems. In: Proceedings of the 4th AIAA/NASA/USAF/OAI symposium on multidisciplinary analysis and optimization, AIAA paper 1992-4821, Cleveland, 21–23 September 1992
Blouin VY, Lassiter JB, Wiecek MM, Fadel GM (2005) Augmented Lagrangian coordination for decomposed design problems. In: Proceedings of the 6th world congress on structural and multidisciplinary optimization, Rio de Janeiro, 30 May–3 June 2005
Braun RD (1996) Collaborative optimization: an architecture for large-scale distributed design. PhD Thesis, Stanford University
Braun RD, Moore AA, Kroo IM (1997) Collaborative approach to launch vehicle design. J Spacecr Rockets 34(4):478–486
Censor Y, Zenios SA (1997) Parallel optimization: theory, algorithms, and applications. Oxford University Press, New York
Chanron V, Singh T, Lewis K (2005) Equilibrium stability in decentralized design systems. Int J Syst Sci 36(10):651–662
Colson B, Marcotte P, Savard G (2007) An overview of bilevel programming. Ann Oper Res 153(1):235–256
Cramer EJ, Dennis JE, Frank PD, Lewis RM, Shubin GR (1994) Problem formulation for multidisciplinary optimization. SIAM J Optim 4(4):754–776
DeMiguel AV, Murray W (2000) An analysis of collaborative optimization methods. In: Proceedings of the 8th AIAA/USAF/NASA/ISSMO symposium on multidisciplinary analysis and optimization, AIAA paper 2000-4720, Long Beach, 6–8 September 2000
DeMiguel AV, Murray W (2006) A local convergence analysis of bilevel decomposition algorithms. Optim Eng 7(2):99–133
DeMiguel AV, Nogales FJ (2008) On decomposition methods for a class of partially separable nonlinear programs. Math Oper Res 33(1):119–139
Etman LFP, Kokkolaras M, Hofkamp AT, Papalambros PY, Rooda JE (2005) Coordination specification in distributed optimal design of multilevel systems using the χ language. Struct Multidisc Optim 29(3):198–212
Ferris MC, Mangasarian OL (1994) Parallel variable distribution. SIAM J Optim 4(4):815–832
Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear Gauss-Seidel method under convex constraints. Oper Res Lett 26(3):127–136
Haftka RT, Watson LT (2005) Multidisciplinary design optimization with quasiseparable subsystems. Optim Eng 6(1):9–20
Haftka RT, Watson LT (2006) Decomposition theory for multidisciplinary design optimization problems with mixed integer quasiseparable subsystems. Optim Eng 7(2):135–149
Haftka RT, Sobieski J, Padula SL (1992) On options for interdisciplinary analysis and design. Struct Optim 4(2):65–74
Kaufman M, Balabanov V, Burgee SL, Giunta AA, Grossman B, Haftka RT, Mason WH, Watson LT (1996) Variable-complexity response surface approximations for wing structural weight in hsct design. Comput Mech 18(2):112–126
Kim HM (2001) Target cascading in optimal system design. PhD Thesis. University of Michigan
Kim HM, Michelena NF, Papalambros PY, Jiang T (2003) Target cascading in optimal system design. ASME J Mech Des 125(3):474–480
Kim HM, Chen W, Wiecek MM (2006) Lagrangian coordination for enhancing the convergence of analytical target cascading. AIAA J 44(10):2197–2207
Kodiyalam S, Sobieszczanski-Sobieski J (2000) Bilevel integrated system synthesis with response surfaces. AIAA J 38(8):1479–1485
Kokkolaras M, Fellini R, Kim HM, Michelena NF, Papalambros PY (2002) Extension of the target cascading formulation to the design of product families. Struct Multidisc Optim 24(4):293–301
Lasdon LS (1970) Optimization theory for large systems. Macmillan, New York
Lassiter JB, Wiecek MM, Andrighetti KR (2005) Lagrangian coordination and analytical target cascading: solving atc-decomposed problems with lagrangian duality. Eng Optim 6(3):361–381
Lewis K, Mistree F (1998) Collaborative, sequential, and isolated decisions in design. ASME J Mech Des 120(4):643–652
Li Y, Lu Z, Michalek JJ (2008) Diagonal quadratic approximation for parallelization of analytical target cascading. ASME J Mech Des 31(5):1–11
Lin J (2004) Analysis and enhancement of collaborative optimization for multidisciplinary design. AIAA J 42(2):348–360
Liu B, Haftka RT, Watson LT (2004) Global-local structural optimization using response surfaces of local optimization margins. Struct Multidisc Optim 27(5):352–359
Lootsma FA, Ragsdell KM (1988) State-of-the-art in parallel nonlinear programming. Parallel Comput 6(2):133–155
Michelena N, Kim HM, Papalambros PY (1999) A system partitioning and optimization approach to target cascading. In: Proceedings of the 12th international conference on engineering design, Munich, 24–26 August 1999
Michelena NF, Park H, Papalambros PY (2003) Convergence properties of analytical target cascading. AIAA J 41(5):897–905
Migdalas A, Pardalos PM, Värbrand P (1997) Multilevel optimization: algorithms and applications. Springer, Heidelberg
Mulvey JM, Vladimirou H (1991) Applying the progressive hedging algorithm to stochastic generalized networks. Ann Oper Res 31(1):399–424
Pan J, Diaz AR (1990) Some results in optimization of nonhierarchic systems. ASME J Mech Des 112(3):399–405
Park H, Michelena NF, Kulkarni D, Papalambros PY (2001) Convergence criteria for hierarchical overlapping coordination of linearly constrained convex design problems. Comput Optim Appl 18(3):273–293
Perez RE, Liu HHT, Behdinan K (2004) Evaluation of multidisciplinary optimization approaches for aircraft conceptual design. In: Proceedings of the 10th AIAA/ISSMO multidisciplinary analysis and optimization conference, AIAA paper 2004-4537, Albany, 30 August–1 September 2004
Renaud JE, Gabrielle GA (1994) Approximation in nonhierarchic system optimization. AIAA J 32(1):198–205
Roth BD, Kroo IM (2008) Enhanced collaborative optimization: a decomposition-based method for multidisciplinary design. In: Proceedings of the ASME design engineering technical conferences, Brooklyn, New York, 3–6 August 2008
Ruszczynski A (1995) On convergence of an augmented Lagrangian decomposition for sparse convex optimization. Math Oper Res 20(3):634–656
Ruszczynski A (1997) Decomposition methods in stochastic programming. Math Program 79(1–3):333–353
Sagastizábal CA, Solodov MV (2002) Parallel variable distribution for constrained optimization. Comput Optim Appl 22(1):111–131
Shankar J, Ribbens CJ, Haftka RT, Watson LT (1993) Computational study of a nonhierarchical decomposition algorithm. Comput Optim Appl 2(3):273–293
Shin MK, Park GJ (2005) Multidisciplinary design optimization based on independent subspaces. Int J Numer Methods Eng 64(5):599–617
Sobieski IP, Kroo I (2000) Collaborative optimization using response surface estimation. AIAA J 38(10):1931–1938
Sobieszczanski-Sobieski J (1988) Optimization by decomposition: a step from hierarchic to non-hierarchic systems. In: Proceedings of the 2nd NASA air force symposium on advances in multidisciplinary analysis and optimization, NASA CP-3031, Hampton, 28–30 September 1988
Sobieszczanski-Sobieski J (1990) Sensitivity of complex, internally coupled systems. AIAA J 28(1):153–160
Sobieszczanski-Sobieski J, Haftka RT (1997) Multidisciplinary aerospace design optimization: Survey of recent developments. Struct Optim 14(1):1–23
Sobieszczanski-Sobieski J, James BB, Dovi AR (1985) Structural and multidisciplinary optimization by multilevel decomposition. AIAA J 23(11):1775–1782
Sobieszczanski-Sobieski J, Agte JS, Sandusky Jr RR (2000) Bilevel integrated system synthesis. AIAA J 38(1):164–172
Sobieszczanski-Sobieski J, Altus TD, Phillips M, Sandusky Jr RR (2003) Bilevel integrated system synthesis for concurrent and distributed processing. AIAA J 41(10):1996–2003
Tedford NP, Martins JRRA (2006) On the common structure of MDO problems: a comparison of architectures. In: Proceedings of the 11th AIAA/ISSMO multidisciplinary analysis and optimization conference, AIAA paper 2006-7080, Portsmouth, 6–8 Sepember 2006
Tosserams S, Etman LFP, Papalambros PY, Rooda JE (2006) An augmented Lagrangian relaxation for analytical target cascading using the alternating direction method of multipliers. Struct Multidisc Optim 31(3):176–189
Tosserams S, Etman LFP, Rooda JE (2007) An augmented Lagrangian decomposition method for quasi-separable problems in mdo. Struct Multidisc Optim 34(3):211–227
Tosserams S, Etman LFP, Rooda JE (2008a) Augmented Lagrangian coordination for distributed optimal design in mdo. Int J Numer Methods Eng 73(13):1885–1910
Tosserams S, Etman LFP, Rooda JE (2008b) Block-separable linking constraints in augmented Lagrangian coordination. Struct Multidisc Optim. doi:10.1007/s00158-008-0244-5
Vanderplaats GN, Yoshida N (1985) Efficient calculation of optimum design sensitivity. AIAA J 23(11):1798–1803
Vanderplaats GN, Yang YJ, Kim DS (1990) Sequential linearization method for multilevel optimization. AIAA J 28(2):290–295
Vicente LN, Calamai P (1994) Bilevel and multilevel programming: a bibliography review. J Glob Optim 5(3):291–306
Wagner TC (1993) A general decomposition methodology for optimal system design. PhD Thesis. University of Michigan, Ann Arbor
Wagner TC, Papalambros PY (1993) General framework for decomposition analysis in optimal design. In: Gilmore B, Hoeltzel D, Azarm S, Eschenauer H (eds) Advances in design automation. American Society of Mechanical Engineers, Albuquerque, pp 315–325
de Wit AJ, van Keulen F (2008) Framework for multilevel optimization. In: Proceedings of the 5th China-Japan-Korea joint symposium on optimization of structural and mechanical systems, Seoul, June 2008
Yi SI, Shin JK, Park GJ (2008) Comparison of MDO methods with mathematical examples. Struct Multidisc Optim 35(5):391–402
Zadeh PM, Toropov VV, Wood AS (2008) Metamodel-based collaborative optimization framework. Struct Multidisc Optim. doi:10.1007/s00158-008-0286-8
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is funded by MicroNed, grant number 10005898.
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Tosserams, S., Etman, L.F.P. & Rooda, J.E. A classification of methods for distributed system optimization based on formulation structure. Struct Multidisc Optim 39, 503 (2009). https://doi.org/10.1007/s00158-008-0347-z
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00158-008-0347-z