Skip to main content
SpringerLink
Log in

Introduction

  • Chapter
Design and Analysis of Simulation Experiments

Part of the book series: International Series in Operations Research & Management Science ((ISOR,volume 230))

  • 3215 Accesses

Abstract

This chapter is organized as follows. Section 1.1 defines various types of simulation. Section 1.2 defines design and analysis of simulation experiments (DASE). Section 1.3 defines DASE symbols and terms. The chapter ends with Solutions of exercises, and references.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Acar E, Rais-Rohani M (2009) Ensemble of metamodels with optimized weight factors. Struct Multidiscip Optim 37(3):279–294

    Article  Google Scholar 

  • Buchholz A, Holländer N, Sauerbrei W (2008) On properties of predictors derived with a two-step bootstrap model averaging approach—a simulation study in the linear regression model. Comput Stat Data Anal 52:2778–2793

    Article  Google Scholar 

  • Borgonovo E, Plischke E (2015) Sensitivity analysis: a review of recent advances. Eur J Oper Res (in press)

    Google Scholar 

  • Can B, Heavey C (2012) A comparison of genetic programming and artificial neural networks in metamodeling of discrete-event simulation models. Comput Oper Res 39(2):424–436

    Article  Google Scholar 

  • Clarke SM, Griebsch JH, Simpson TW (2005) Analysis of support vector regression for approximation of complex engineering analyses. ASME J Mech Des 127(6):1077–1087

    Article  Google Scholar 

  • Conover WJ (1999) Practical nonparametric statistics, 3rd edn. Wiley, New York

    Google Scholar 

  • Conway RW (1963) Some tactical problems in digital simulation. Manag Sci 10(1):47–61

    Article  Google Scholar 

  • De Rocquigny E, Devictor N, Tarantola S (2008) Uncertainty settings and natures of uncertainty. In: de Rocquigny E, Devictor N (eds) Tarantola suncertainty in industrial practice. Wiley, Chichester

    Chapter  Google Scholar 

  • Dette H, Pepelyshev A (2010) NPUA: a new approach for the analysis of computer experiments. Chemom Intell Lab Syst 104(2):333–340

    Article  Google Scholar 

  • Efron B (2005) Bayesians, frequentists, and scientists. J Am Stat Assoc 100(469):1–5

    Article  Google Scholar 

  • Evans JR, Olson DL (1998) Introduction to simulation and risk analysis. Prentice-Hall, Upper Saddle River

    Google Scholar 

  • Fang K-T, Li R, Sudjianto A (2006) Design and modeling for computer experiments. Chapman & Hall/CRC, London

    Google Scholar 

  • Forrester AIJ, Keane AJ (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79

    Article  Google Scholar 

  • Forrester A, SĂłbester A, Keane A (2008) Engineering design via surrogate modelling: a practical guide. Wiley, Chichester

    Book  Google Scholar 

  • Forrester JW (1961) Industrial dynamics. MIT, Cambridge

    Google Scholar 

  • Giambiasi N, Carmona JC (2006) Generalized discrete event abstraction of continuous systems: GDEVS formalism. Simul Model Pract Theory 14(1):47–70

    Article  Google Scholar 

  • Gorissen D (2010) Grid-enabled adaptive surrogate modeling for computer aided engineering. Ph.D. dissertation, Ghent University, Ghent

    Google Scholar 

  • Grubler, A., Y. Ermoliev, and A. Kryazhimskiy (2015), Coping with uncertainties-examples of modeling approaches at IIASA. Technological Forecasting and Social Change, in press

    Google Scholar 

  • Harari O, Steinberg DM (2014) Convex combination of Gaussian processes for Bayesian analysis of deterministic computer experiments. Technometrics 56(4):443–454

    Article  Google Scholar 

  • Helton JC, Davis FJ (2003) Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems. Reliab Eng Syst Saf 81:23–69

    Article  Google Scholar 

  • Helton JC, Hansen CW, Swift PN (2014) Performance assessment for the proposed high-level radioactive waste repository at Yucca mountain, Nevada.  Reliab Eng Syst Saf 122:1–6

    Article  Google Scholar 

  • Henderson SG, Nelson BL (eds) (2006) Handbooks in operations research and management science, vol 13. North-Holland, Amsterdam

    Google Scholar 

  • Ho Y, Cao X (1991) Perturbation analysis of discrete event dynamic systems. Kluwer, Dordrecht

    Book  Google Scholar 

  • KamiĹ„ski, B. (2015) Interval metamodels for the analysis of simulation input-output relations. Simulation Modelling Practice and Theory, 54:86–100

    Article  Google Scholar 

  • Karplus WJ (1983) The spectrum of mathematical models. Perspect Comput 3(2):4–13

    Google Scholar 

  • Kleijnen JPC (1975) A comment on Blanning’s metamodel for sensitivity analysis: the regression metamodel in simulation. Interfaces 5(3):21–23

    Article  Google Scholar 

  • Kleijnen JPC (1987) Statistical tools for simulation practitioners. Marcel Dekker, New York

    Google Scholar 

  • Kleijnen JPC (2007) Risk analysis: frequentist and Bayesians unite! In: YĂĽcesan E (ed) Proceedings of the 2007 INFORMS Simulation Society Research Workshop, Fontainebleau, pp 61–65

    Google Scholar 

  • Kleijnen JPC (2008) Design and analysis of simulation experiments. Springer, New York

    Google Scholar 

  • Law AM (2015) Simulation modeling and analysis, 5th edn. McGraw-Hill, Boston

    Google Scholar 

  • Levy S, Steinberg DM (2010) Computer experiments: a review. AStA Adv Stat Anal 94(4):311–324

    Article  Google Scholar 

  • Mordecai Y, Dori D (2013) Model-based risk-oriented robust systems design with object-process methodology. Int J Strateg Eng Asset Manag 1(4):331–354

    Article  Google Scholar 

  • MĂĽller J, Shoemaker CA (2014) Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems. J Glob Optim 60:123–144

    Article  Google Scholar 

  • Nance RE, Sargent RG (2002) Perspectives on the evolution of simulation. Oper Res 50(1):161–172

    Article  Google Scholar 

  • Nelson BL (2013) Foundations and methods of stochastic simulation; a first course. Springer, New York

    Book  Google Scholar 

  • Oden JT (2006) Revolutionizing engineering science through simulation. National Science Foundation (NSF) Blue Ribbon Panel on Simulation-based Engineering Science. National Science Foundation, Arlington

    Google Scholar 

  • Picheny V, Ginsbourger D, Richet Y, Caplin G (2013) Quantile-based optimization of noisy computer experiments with tunable precision, including comments and rejoinder. Technometrics 55(1):1–36

    Article  Google Scholar 

  • Pidd M (2004)Computer simulation in management science, 5th edn. Wiley, Chichester

    Google Scholar 

  • Poropudas J, Virtanen K (2008) Game theoretic approach to air combat simulation analysis. Systems Analysis Laboratory, Helsinki University of Technology

    Google Scholar 

  • Rasmussen CE, Williams C (2006) Gaussian processes for machine learning. MIT, Cambridge

    Google Scholar 

  • Razavi S, Gupta HV (2015) What do we mean by sensitivity analysis? The need for comprehensive characterization of “global” sensitivity in earth and environmental systems models. Water Resour Res 51 (in press)

    Google Scholar 

  • Razavi S, Tolson BA, Burn DH (2012) Review of surrogate modeling in water resources. Water Resour Res 48, W07401:1–322

    Google Scholar 

  • Regis RG (2014) Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points. Eng Optim 46(2):218–243

    Article  Google Scholar 

  • Rieck K et al (2012) Support vector machines. In: Gentle JE, Haerdle W, Mori Y (eds) Handbook of computational statistics, concepts and fundamentals, vol 1, 2nd edn. Springer, Heidelberg, pp 883–926

    Chapter  Google Scholar 

  • Sakallı ÜS, Baykoç Ă–F (2011) An optimization approach for brass casting blending problem under aletory and epistemic uncertainties. Int J Prod Econ 133(2):708–718

    Article  Google Scholar 

  • Saltelli, Ratto M, Tarantola S, Campolongo F (2005) Sensitivity analysis of chemical models. Chem Rev 105(7):2811–2827

    Article  Google Scholar 

  • Sanchez SM, Lucas TW, Sanchez PJ, Nannini CJ, Wan H (2012) Chapter 12: designs for large-scale simulation experiments, with applications to defense and homeland security. In: Hinkelmann K (ed) Design and analysis of experiments, volume 3, special designs and applications. Wiley, New York, pp 413–442

    Chapter  Google Scholar 

  • Santner TJ, Williams BJ, Notz WI (2003) The design and analysis of computer experiments. Springer, New York

    Book  Google Scholar 

  • Santos MI, Santos PM (2008) Sequential experimental designs for nonlinear regression metamodels in simulation. Simul Model Pract Theory 16(9):1365–1378

    Article  Google Scholar 

  • Schriber TJ (2009) Simulation for the masses: spreadsheet-based Monte Carlo simulation. In: Rossetti MD, Hill RR, Johansson B, Dunkin A, Ingalls RG (eds) Proceedings of the 2009 Winter Simulation Conference, Austin, pp 1–11

    Google Scholar 

  • Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 1968 ACM National Conference, New York, pp 517–524. doi:10.1145/800186.810616

    Google Scholar 

  • Shubik M (2002) Game theory and operations research: some musings 50 years later. Oper Res 50(1):192–196

    Article  Google Scholar 

  • Simchi-Levi D, Kaminsky P, Simchi-Levi E (2003) Designing and managing the supply chain: concepts, strategies, and case studies, 2nd edn. Irwin/McGraw-Hill, Boston

    Google Scholar 

  • Sprent P, Smeeton NC (2007) Applied nonparametric statistical methods, 4th edn. Chapman & Hall/CRC, Atlanta

    Google Scholar 

  • Sterman JD (2000) Business dynamics: systems thinking and modeling for a complex world. McGraw-Hill, Homewood

    Google Scholar 

  • Storlie C, Swiler L, Helton J, Sallaberry C (2009) Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models, SAND report 2008-6570. Sandia, Albuquerque

    Google Scholar 

  • Swain JJ (2005) “Gaming” reality. OR/MS Today 32(6):44–55

    Google Scholar 

  • Swain JJ (2013) Simulation software: a better reality? OR/MS Today 40(5):48–59

    Google Scholar 

  • Tan MHY (2014) Stochastic polynomial interpolation for uncertainty quantification with computer experiments. Technometrics (in press)

    Google Scholar 

  • Van Gelder L, Das P, Janssen H, Roels S (2014) Comparative study of metamodelling techniques in building energy simulation: guidelines for practitioners. Simul Model Pract Theory 49:245–257

    Article  Google Scholar 

  • Viana FAC, Simpson TW, Balabanov V, Toropov V (2014) Metamodeling in multidisciplinary design optimization: how far have we really come? AIAA J 52(4):670–690

    Article  Google Scholar 

  • Villa-Vialaneix N, Follador M, Ratto M, Leip A (2012) A comparison of eight metamodeling techniques for the simulation of N 2O fluxes and N leaching from corn crops. Environ Model Softw 34:51–66

    Article  Google Scholar 

  • Vose D (2000) Risk analysis; a quantitative guide, 2nd edn. Wiley, Chichester

    Google Scholar 

  • Wang C, Duan Q, Gong W, Ye A, Di Z, Miao C (2014) An evaluation of adaptive surrogate modeling based optimization with two benchmark problems. Environ Model Softw 60:167–179

    Article  Google Scholar 

  • Wiebenga JH (2014) Robust design and optimization of forming processes. Ph.D. thesis, University of Twente, Enschede

    Google Scholar 

  • Wu DD, Olson DL (2013) Computational simulation and risk analysis: an introduction of state of the art research. Math Comput Model 58(9–10):1581–1587

    Article  Google Scholar 

  • Xie W, Nelson BL, Barton RR (2014) A Bayesian framework for quantifying uncertainty in stochastic simulation. Oper Res 62(6):1439–1452

    Article  Google Scholar 

  • Zeigler BP, Praehofer H, Kim TG (2000) Theory of modeling and simulation, 2nd edn. Academic, San Diego

    Google Scholar 

  • Zhu P, Zhang Y, Chen G (2011) Metamodeling development for reliability-based design optimization of automotive body structure. Comput Ind 62(7):729–741

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Management, Tilburg University, Tilburg, The Netherlands

    Jack P. C. Kleijnen

Authors
  1. Jack P. C. Kleijnen
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Kleijnen, J.P.C. (2015). Introduction. In: Design and Analysis of Simulation Experiments. International Series in Operations Research & Management Science, vol 230. Springer, Cham. https://doi.org/10.1007/978-3-319-18087-8_1

Download citation

Publish with us

Policies and ethics

Search

Navigation