Optimization Under Uncertainties

  • Rafael H. LopezEmail author
  • André T. Beck
Part of the Advanced Structured Materials book series (STRUCTMAT, volume 43)


The goal of this chapter is to present the main approaches to optimization of engineering systems in the presence of uncertainties. That is, the chapter should serve as a guide to those entering in the exciting and challenging subject of optimization under uncertainties. First, the basic concepts of optimization and uncertainty quantification are presented separately. Then, the optimization under uncertainties techniques are described. We begin by giving an insight about the stochastic programming, also known as robust optimization in the engineering fields. Next, we detail how to deal with probabilistic constraints in optimization, the so called the reliability based design. Subsequently, we present the risk optimization approach, which includes the expected costs of failure in the objective function.


  1. 1.
    Agarwal, H., Mozumder, C.K., Renaud, J.E., Watson, L.T.: An inverse-measure-based unilevel architecture for reliability-based design. Structural and Multidisciplinary Optimization 33, 217–227 (2007)CrossRefGoogle Scholar
  2. 2.
    Aoues, Y., Chateauneuf, A.: Benchmark study of numerical methods for reliability-based design optimization. Structural and Multidisciplinary Optimization 41, 277–294 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Arora, J.S.: Introduction to optimum design. Elsevier, London (2004)Google Scholar
  4. 4.
    Athan, T.W., Papalambros, P.Y.: A note on weighted criteria methods for compromise solutions in multi-objective optimization. Engineering Optimization 27, 155–176 (1996)CrossRefGoogle Scholar
  5. 5.
    Bastin, F.: Trust-region algorithms for nonlinear stochastic programming and mixed logit models. Thesis (PhD), Facultes Universitaires Notre-Dame de la Paix Namur (2004)Google Scholar
  6. 6.
    Beck, A.T., da Rosa, E.: Structural Reliability Analysis Using Deterministic Finite Element Programs. Latin American Journal of Solids and Structures 3, 197–222 (2006)Google Scholar
  7. 7.
    Beck, A.T., Gomes, W.J.S.: A Comparison of Deterministic, Reliability-Based and Risk-Based Design Optimization. Probabilistic Engineering Mechanics 28, 18–29 (2012)CrossRefGoogle Scholar
  8. 8.
    Beck, A.T., Gomes, W.J.S., Bazán, F.A.V.: On the Robustness of Structural Risk Optimization with Respect to Epistemic Uncertainties. International Journal for Uncertainty Quantification 2, 1–20 (2012)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Beck, A.T., Verzenhassi, C.C.: Risk Optimization of a Steel Frame Communications Tower Subject to Tornado Winds. Latin American Journal of Solids and Structures 5, 187–203 (2008)Google Scholar
  10. 10.
    Beyer, H.G., Sendhoff, B.: Robust optimization - a comprehensive review. Computational Methods in Applied Mechanics and Engineering 196, 3190–3218 (2006)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Birge, J.R., Louveaux, F.V.: Introduction to Stochastic Programming. Springer, New York (1997)Google Scholar
  12. 12.
    Box G, Fung C (1986) Studies in quality improvement: minimizing transmitted variation by parameter design. In: Report No. 8, Center for Quality Improvement, University of Wisconsin.Google Scholar
  13. 13.
    Capiez-Lernout, E., Soize, C.: Design optimization with an uncertain vibroacustic model. Journal of Vibration and Acoustic 130(021001–1), 021001–8 (2008)CrossRefGoogle Scholar
  14. 14.
    Cheng, G.D., Xu, L., Jiang, L.: Sequential approximate programming strategy for reliability-based optimization. Computers and Structures 84, 1353–67 (2006)CrossRefGoogle Scholar
  15. 15.
    Chinchuluun, A., Pardalos, P.M.: A survey of recent developments in multiobjective optimization. Annals of Operations Research 159, 29–50 (2007)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Choi, S.K., Grandhi, R.V., Canfield, R.A.: Reliability-based structural design. Springer-Verlag, London (2007)zbMATHGoogle Scholar
  17. 17.
    Das, I., Dennis, J.E.: A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multi-criteria optimization problems. Structural Optimization 14, 63–69 (1997)CrossRefGoogle Scholar
  18. 18.
    Das, I., Dennis, J.E.: Normal-boundary intersection: a new method for generating Pareto optimal point in nonlinear multicriteria optimization problems. SIAM Journal on Optimization 8, 631–657 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Doltsinis, I., Kang, Z.: Robust design of structures using optimization methods. Computational Methods in Applied Mechanics and Engineering 193, 2221–2237 (2004)CrossRefzbMATHGoogle Scholar
  20. 20.
    Du Bois, D.: Fuzzy sets and systems: theory and applications. Academic Press, New York (1980)Google Scholar
  21. 21.
    Du, X., Chen, W.: Sequential Optimization and Reliability Assessment method for Efficient Probabilistic Design. ASME J Mech Des 126, 225–233 (2004)CrossRefGoogle Scholar
  22. 22.
    Du, X., Chen, W.: Towards a better understanding of modeling feasibility robustness in engineering design. Journal of Mechanical Design 122, 385–394 (2000)CrossRefGoogle Scholar
  23. 23.
    Du, X.: Saddlepoint Approximation for Sequential Optimization and Reliability Analysis. ASME J Mech Des 130(011011), 1–11 (2008)Google Scholar
  24. 24.
    Engelund, S., Rackwitz, R.: A benchmark study on importance sampling techniques in structural reliability. Struct Safety 12, 255–76 (1993)CrossRefGoogle Scholar
  25. 25.
    Feller, W.: An Introduction to Probability Theory and its Applications. Wiley, New York (1968)zbMATHGoogle Scholar
  26. 26.
    Gomes WJS, Beck AT (2013) Global structural optimization considering expected consequences of failure and using ANN surrogates. to appear in Computers & Structures (accepted paper), Scholar
  27. 27.
    Haldar, A., Mahadevan, S.: Reliability Assessment Using Stochastic Finite Element Analysis. John Wiley & Sons, New York (2000)Google Scholar
  28. 28.
    Hasofer AM, Lind NC (1974) An exact and invariant first order reliability format. Journal of the Engineering Mechanics Division. 100(EM1):111–21.Google Scholar
  29. 29.
    Kall, P., Wallace, S.W.: Stochastic programming. John Wiley & Sons, Chichester (1994)zbMATHGoogle Scholar
  30. 30.
    Kiefer, J., Wolfowitz, J.: Stochastic estimation of the maximum of a regression function. Annals of Mathematical Statistics 23, 462–466 (1952)MathSciNetCrossRefzbMATHGoogle Scholar
  31. 31.
    Kleywegt, A.J., Shapiro, A.: Stochastic Optimization: Handbook of Industrial Engineering. John Wiley, New York (2001)Google Scholar
  32. 32.
    Lee, K.H., Park, G.J.: Robust optimization considering tolerances of design variables. Computers and Structures 79, 77–86 (2001)CrossRefGoogle Scholar
  33. 33.
    Kuschel, N., Rackwitz, R.: A new approach for structural optimization of series systems. Applications of Statistics and Probability 2, 987–994 (2000)Google Scholar
  34. 34.
    Le Riche R (2009) Projet OMD: Optimiser les systèmes complexes en présence d’incertitudes. Cahiers de l’ANR No. 2: calcul intensif.Google Scholar
  35. 35.
    Lee, S.H., ChenW, : A comparative study of uncertainty propagation methods for black-box-type problems. Structural and Multidisciplinary Optimization 37, 239–253 (2009)Google Scholar
  36. 36.
    Lee, J., Yang, S., Ruy, W.: A comparative study on reliability index and target performance based probabilistic structural design optimization. Computer & Structures 257, 269–80 (2002)Google Scholar
  37. 37.
    Lee, S.H., Kwak, B.M.: Response surface augmented moment method for efficient reliability analysis. Structural Safety 28, 261–272 (2006)CrossRefGoogle Scholar
  38. 38.
    Lemaire, M., Chateauneuf, A., Mitteau, J.C.: Fiabilité des structures. Lavoisier, Paris (2005)Google Scholar
  39. 39.
    Lopez RH, Luersen M, Cursi ES (2009a) Optimization of laminated composites considering different failure criteria. Composites: Part B 40:731–740.Google Scholar
  40. 40.
    Lopez, R.H., Luersen, M., Cursi, E.S.: Optimization of hybrid laminated composites using a genetic algorithm. Journal of the Brazilian Society of Mechanical Engineering 31, 269–278 (2009b)CrossRefGoogle Scholar
  41. 41.
    Lopez, R.H., Cursi, E.S., Lemosse, D.: An approach for the reliability based design optimization of laminated composites. Engineering Optimization 43, 1079–1094 (2011)MathSciNetCrossRefGoogle Scholar
  42. 42.
    Lopez, R.H., Lemosse, D., Cursi, E.S., Rojas, J., El-Hami, A.: Approximating the probability density function of the optimal point of an optimization problem. Engineering Optimization 43, 281–303 (2011)MathSciNetCrossRefGoogle Scholar
  43. 43.
    Lopez, R.H.: Optimisation en présence d’incertitudes. Thèse de Doctorat, INSA de Rouen, France (2010)Google Scholar
  44. 44.
    Luersen, M.A., Riche, R.: Globalized Nelder-Mead method for engineering optimization. Computers and Structures 82, 2251–2260 (2004)CrossRefGoogle Scholar
  45. 45.
    Madsen, H.O., Krenk, S., Lind, N.C.: Methods of structural safety. Prentice Hall, Englewood Cliffs (1986)Google Scholar
  46. 46.
    Melchers, R.E.: Structural Reliability Analysis and Prediction. John Wiley & Sons, Chichester (1999)Google Scholar
  47. 47.
    Messac, A.: Physical programming effective optimization for computational design. AIAA Journal 34, 149–158 (1996)CrossRefzbMATHGoogle Scholar
  48. 48.
    Messac, A., Ismail-Yahaya, A., Mattson, C.A.: The normalized normal constraint method for generating the Pareto frontier. Structural and Multidisciplinary Optimization 25, 86–98 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  49. 49.
    Messac, A., Mattson, C.: Normal constraint method with guarantee of even representation of complete Pareto frontier. AIAA Journal 42, 2101–2111 (2004)CrossRefGoogle Scholar
  50. 50.
    Míngues, R., Castillo, E.: Reliability-based optimization in engineering using decomposition techniques and FORMS. Structural Safety 31, 214–223 (2008)CrossRefGoogle Scholar
  51. 51.
    Moller, B., Beer, M.: Engineering computation under uncertainty: capabilities of non-traditional models. Computers and Structures 86, 1024-1041 (2008)Google Scholar
  52. 52.
    Moore, R.E.: Interval analysis. Prentice-Hall, New York (1966)zbMATHGoogle Scholar
  53. 53.
    Nair, V.N., Abraham, B., MacKay, J., et al.: Taguchi’s parameter design: a panel discussion. Technometrics 34, 127–161 (1992)MathSciNetCrossRefGoogle Scholar
  54. 54.
    Nie, J., Ellingwood, B.R.: Directional methods for structural reliability analysis. Structural Safety 22, 233–49 (2000)CrossRefGoogle Scholar
  55. 55.
    Niederreiter, H., Spanier, J.: Monte Carlo and quasi-Monte Carlo methods. Springer, Berlin (2000)zbMATHGoogle Scholar
  56. 56.
    Parkinson, A., Sorensen, C., Pourhassan, N.: A General Approach for Robust Optimal Design. ASME Journal of Mechanical Design 115, 74–80 (1993)CrossRefGoogle Scholar
  57. 57.
    Phadke, M.S.: Quality engineering using robust design. Prentice-Hall, New Jersey (1989)Google Scholar
  58. 58.
    Pogu, M., Souza de Cursi, J.E.: Global optimization by random perturbation of the gradient method with a fixed parameter. Journal of Global Optimization 5, 159–180 (1994)MathSciNetCrossRefzbMATHGoogle Scholar
  59. 59.
    Rahman, S., Xu, H.: A univariate dimension-reduction method for multi-dimensional integration in stochastic mechanics. Probabilitic Engineering Mechanics 19, 393–408 (2004)CrossRefGoogle Scholar
  60. 60.
    Ritto, T., Lopez, R.H., Sampaio, R., Cursi, E.S.: Robust optimization of a flexible rotor-bearing system using the Campbell diagram. Engineering Optimization 43, 77–96 (2011)MathSciNetCrossRefGoogle Scholar
  61. 61.
    Robbins, H., Monro, S.: A stochastic approximation method. Annals of Mathematical Statistics 22, 400–407 (1951)MathSciNetCrossRefzbMATHGoogle Scholar
  62. 62.
    Rubinstein, R.Y.: Simulation and the Monte Carlo method. Wiley, New York (1981)CrossRefzbMATHGoogle Scholar
  63. 63.
    Sacks, J., Welch, W., Mitchell, J., Wynn, H.: Design and analysis of computer experiments. Statistical Science 4, 409–435 (1989)MathSciNetCrossRefzbMATHGoogle Scholar
  64. 64.
    Schuëller, G.I., Jensen, H.A.: Computational methods in optimization considering uncertainties - an overview. Computer Methods in Applied Mechanics and Engineering 198, 2–13 (2009)CrossRefGoogle Scholar
  65. 65.
    Sahinidis, N.V.: Optimization under uncertainty: state-of-the-art and opportunities. Computer & Chemical Engineering 28, 971–983 (2004)CrossRefGoogle Scholar
  66. 66.
    Sanchis, J., Martinez, M., Blasco, X.: Multi-objective engineering design using preferences. Engineering Optimization 40, 253–269 (2008)CrossRefGoogle Scholar
  67. 67.
    Seo, H.S., Kwak, B.M.: Efficient statistical tolerance analysis for general distributions using three-point information. International journal of production research 40, 931–944 (2002)CrossRefzbMATHGoogle Scholar
  68. 68.
    Shafer, G.: A Mathematical theory of evidence. Princeton University Press, Princeton (1976)zbMATHGoogle Scholar
  69. 69.
    Shapiro, A., Homem-de-Melo, T.: A simulation-based approach to two-stage stochastic programming with recourse. Mathematical Programming 81, 301–325 (1998)MathSciNetzbMATHGoogle Scholar
  70. 70.
    Souza de Cursi JE, Cortes MBS (1995) General Genetic algorithms and simulated annealing perturbation of the gradient method with a fixed parameter. In: Topping, B.H.V. (Ed.), Developments in Neural Networks and Evolutionary Computing for Civil and Structural, Engineering, 189–198.Google Scholar
  71. 71.
    Taguchi, G.: Quality engineering through design optimization. Krauss International Publications, New York (1986)Google Scholar
  72. 72.
    Taguchi, G.: System of experimental design. IEEE Journal 33, 1106–1113 (1987)Google Scholar
  73. 73.
    Taguchi G (1989) Introduction to Quality Engineering. American Supplier Institute.Google Scholar
  74. 74.
    Torii, A.J., Lopez, R.H., Biondini, F.: An approach to reliability-based shape and topology optimization of truss structures. Engineering Optimization 44, 37–53 (2011)CrossRefGoogle Scholar
  75. 75.
    Tsui, K.L.: An overview of Taguchi method and newly developed statistical methods for robust design. IIE Transactions 24, 44–57 (1992)CrossRefGoogle Scholar
  76. 76.
    Tu, J., Choi, K.K., Park, Y.H.: A new study on reliability-based design optimization. J Mech Des 121(4), 557–64 (1999)CrossRefGoogle Scholar
  77. 77.
    Wets, R.J.B.: Stochastic programming: Handbook for Operations Research and Management Sciences. Elsevier, Amsterdam (1989)Google Scholar
  78. 78.
    Xiu, D., Karniadakis, G.E.: The Wiener-Askey polynomial chaos for stochastic differential equations. SIAM Journal on Scientific Computing 24, 619–644 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  79. 79.
    Yang, R.J., Chuang, C., Gu, L., Li, G.: Experience with approximate reliability based optimization methods II: an exhaust system problem. Structural Multidisciplinary Optimization 29, 488–497 (2005)CrossRefGoogle Scholar
  80. 80.
    Yang, R.J., Gu, L.: Experience with approximate reliability based optimization methods. Structural and Multidisciplinary Optimization 26, 152–159 (2004)CrossRefGoogle Scholar
  81. 81.
    Yi, P., Cheng, G.D., Jiang, L.: A Sequential approximate programming strategy for performance measure based probabilistic structural design optimization. Structural Safety 30, 91–109 (2008)CrossRefGoogle Scholar
  82. 82.
    Yi, P., Cheng, G.D.: Further study on efficiency of sequential approximate programming strategy for probabilistic structural design optimization. Structural and Multidisciplinary Optimization 35, 509–522 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  83. 83.
    Youn, B.D., Choi, K.K., Park, Y.H.: Hybrid analysis method for reliability-based design optimization. J Mech Des 125, 221–32 (2003)CrossRefGoogle Scholar
  84. 84.
    Youn, B.D., Choi, K.K.: An investigation of nonlinearity of reliability-based design optimization approaches. J Mech Des 126, 403–11 (2004b)CrossRefGoogle Scholar
  85. 85.
    Youn, B.D., Choi, K.K.: Selecting Probabilistic Approaches for Reliability Based Design Optimization. AIAA Journal 124, 131–42 (2004a)Google Scholar
  86. 86.
    Zadeh, L.A.: Fuzzy sets. Information and control 8, 338-353 (1965)Google Scholar
  87. 87.
    Zhang, Q., Li, H.: MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Transactions on evolutionary computation 11, 712–731 (2007)CrossRefGoogle Scholar
  88. 88.
    Zimmermann, H.J.: Fuzzy Set Theory and its Applications. Springer, Berlin (1992)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  1. 1.Civil Engineering DepartmentFederal University of Santa CatarinaFlorianópolisBrazil
  2. 2.Department of Structural Engineering, São Carlos School of EngineeringUniversity of São PauloSão CarlosBrazil

Personalised recommendations