Skip to main content
SpringerLink
Log in
Book cover

The Design and Analysis of Computer Experiments pp 201–246Cite as

Some Criterion-Based Experimental Designs

  • Chapter
  • First Online:

Part of the book series: Springer Series in Statistics ((SSS))

Abstract

Chapter 5 considered designs that attempt to spread observations “evenly” throughout the experimental region. Such designs were called space-filling designs. Recall that one rationale for using a space-filling design is the following. If it is believed that interesting features of the true model are just as likely to be in one part of the input region as another, observations should be taken in all portions of the input region. There are many heuristic criteria for producing designs that might be considered space-filling; several of these were discussed in Chap. 5. However none of the methods was tied to a statistical justification, and no single criterion was singled out as best.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Balling R (2003) The maximin fitness function: A multiobjective city and regional planning. In: Fonseca C, Fleming P, Zitzler E, Deb K, Thiele L (eds) Evolutionary multi-criterion optimization. Springer, Berlin, pp 1–15

    MATH  Google Scholar 

  • Bautista DC (2009) A sequential design for approximating the Pareto front using the expected Pareto improvement function. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH

    Google Scholar 

  • Bernardo MC, Buck RJ, Liu L, Nazaret WA, Sacks J, Welch WJ (1992) Integrated circuit design optimization using a sequential strategy. IEEE Trans Comput Aided Des 11:361–372

    Article  Google Scholar 

  • Coello Coello CA, Lamont GB, Van Veldhuizen DA (2006) Evolutionary algorithms for solving multi-objective problems (genetic and evolutionary computation). Springer, New York, NY

    MATH  Google Scholar 

  • Currin C, Mitchell TJ, Morris MD, Ylvisaker D (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc 86:953–963

    Article  MathSciNet  Google Scholar 

  • Emmerich MT, Giannakoglou KC, Naujoks B (2006) Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels. IEEE Trans Evol Comput 10(4):421–439

    Article  Google Scholar 

  • Fonseca CM, Paquete L, López-Ibáñez M (2006) An improved dimension -sweep algorithm for the hypervolume indicator. In: IEEE congress on evolutionary computation. IEEE Press, New York, NY, pp 1157–1163

    Google Scholar 

  • Forrester A, Sóbester A, Keane A (2007) Multi-fidelity optimization via surrogate modeling. Proc R Soc A 463(2088):3251–3269

    Article  Google Scholar 

  • Gramacy RB, Gray GA, Le Digabel S, Lee HKH, Ranjan P, Wells G, Wild SM (2016) Modeling an augmented Lagrangian for blackbox constrained optimization (with discussion). Technometrics 58(1):1–29

    Article  MathSciNet  Google Scholar 

  • Johnson ME, Moore LM, Ylvisaker D (1990) Minimax and maximin distance designs. J Stat Plann Inf 26:131–148

    Article  MathSciNet  Google Scholar 

  • Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13:455–492

    Article  MathSciNet  Google Scholar 

  • Keane AJ (2006) Statistical improvement criteria for use in multiobjective design optimization. AIAA J 44:879–891

    Article  Google Scholar 

  • Lam CQ, Notz WI (2008) Sequential adaptive designs in computer experiments for response surface model fit. Stat Appl 6:207–233

    Google Scholar 

  • Leatherman ER, Dean AM, Santner TJ (2014) Computer experiment designs via particle swarm optimization. In: Melas VB, Mignani S, Monari P, Salmaso L (eds) Topics in statistical simulation: research papers from the 7th international workshop on statistical simulation, vol 114. Springer, Berlin, pp 309–317

    Google Scholar 

  • Leatherman ER, Dean AM, Santner TJ (2017) Designing combined physical and computer experiments to maximize prediction accuracy. Comput Stat Data Anal 113:346–362

    Article  MathSciNet  Google Scholar 

  • Leatherman ER, Santner TJ, Dean AM (2018) Computer experiment designs for accurate prediction. Stat Comput 28:739–751

    Article  MathSciNet  Google Scholar 

  • Lindley DV (1956) On a measure of information provided by an experiment. Ann Math Stat 27:986–1005

    Article  MathSciNet  Google Scholar 

  • Loeppky JL, Sacks J, Welch WJ (2009) Choosing the sample size of a computer experiment: a practical guide. Technometrics 51(4):366–376

    Article  MathSciNet  Google Scholar 

  • Loeppky JL, Moore LM, Williams BJ (2010) Batch sequential designs for computer experiments. J Stat Plann Inf 140(6):1452–1464

    Article  MathSciNet  Google Scholar 

  • Mitchell TJ (1974) An algorithm for the construction of “D-optimal” experimental designs. Technometrics 16:203–210

    MathSciNet  MATH  Google Scholar 

  • Mitchell TJ, Scott DS (1987) A computer program for the design of group testing experiments. Commun Stat Theory Methods 16:2943–2955

    Article  Google Scholar 

  • Mockus J, Tiešis V, Žilinskas A (1978) The application of Bayesian methods for seeking the extremum. In: Dixon LCW, Szego GP (eds) Towards global optimisation, vol 2. North Holland, Amsterdam, pp 117–129

    Google Scholar 

  • Mockus A, Mockus J, Mockus L (1994) Bayesian approach adapting stochastic and heuristic methods of global and discrete optimization. Informatica 5:123–166

    MathSciNet  MATH  Google Scholar 

  • Nocedal J, Wright S (2006) Numerical optimization. Springer series in operations research and financial engineering. Springer, New York, NY

    Google Scholar 

  • Notz WI (2015) Expected improvement designs. In: Bingham D, Dean AM, Morris M, Stufken J (eds) Handbook of design and analysis of experiments. Chapman and Hall, New York, NY, pp 675–716

    Google Scholar 

  • Picard R, Williams B (2013) Rare event estimation for computer models. Am Stat 67(1):22–32

    Article  MathSciNet  Google Scholar 

  • Picheny V, Ginsbourger D, Richet Y, Caplin G (2013) Quantile-based optimization of noisy computer experiments with tunable precision. Technometrics 55(1):2–13

    Article  MathSciNet  Google Scholar 

  • Pukelsheim F (1993) Optimal design of experiments. Wiley, New York, NY

    MATH  Google Scholar 

  • Ranjan P, Bingham D, Michailidis G (2008) Sequential experiment design for contour estimation from complex computer codes. Technometrics 50(4):527–541

    Article  MathSciNet  Google Scholar 

  • Roy S, Notz WI (2014) Estimating percentiles in computer experiments: a comparison of sequential-adaptive designs and fixed designs. Stat Theory Practice 8:12–29

    Article  MathSciNet  Google Scholar 

  • Sacks J, Schiller SB, Welch WJ (1989a) Design for computer experiments. Technometrics 31:41–47

    Article  MathSciNet  Google Scholar 

  • Schonlau M (1997) Computer experiments and global optimization. PhD thesis, Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, ON

    Google Scholar 

  • Schonlau M, Welch WJ, Jones DR (1998) Global versus local search in constrained optimization of computer models. In: Flournoy N, Rosenberger WF, Wong WK (eds) New developments and applications in experimental design, vol 34. Institute of Mathematical Statistics, pp 11–25

    Google Scholar 

  • Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423

    Article  MathSciNet  Google Scholar 

  • Shewry MC, Wynn HP (1987) Maximum entropy sampling. J Appl Stat 14:165–170

    Article  Google Scholar 

  • Svenson JD (2011) Computer experiments: multiobjective optimization and sensitivity analysis. PhD thesis, Department of Statistics, The Ohio State University, Columbus, OH

    Google Scholar 

  • Svenson J, Santner T (2016) Multiobjective optimization of expensive-to-evaluate deterministic computer simulator models. Comput Stat Data Anal 94:250–264

    Article  MathSciNet  Google Scholar 

  • Weaver BP, Williams BJ, Anderson-Cook CM, Higdon DM (2016) Computational enhancements to Bayesian design of experiments using Gaussian processes. Bayesian Anal 11(1):191–213

    Article  MathSciNet  Google Scholar 

  • Welch WJ, Buck RJ, Sacks J, Wynn HP, Mitchell TJ, Morris MD (1992) Screening, predicting, and computer experiments. Technometrics 34:15–25

    Article  Google Scholar 

  • Williams BJ, Santner TJ, Notz WI (2000) Sequential design of computer experiments to minimize integrated response functions. Stat Sinica 10:1133–1152

    MathSciNet  MATH  Google Scholar 

  • Williams BJ, Santner TJ, Notz WI, Lehman JS (2010) Sequential design of computer experiments for constrained optimization. In: Kneib T, Tutz G (eds) Statistical modelling and regression structures: Festschrift in Honour of Ludwig Fahrmeir. Physica-Verlag, Heidelberg, pp 449–472

    Chapter  Google Scholar 

  • Zitzler E, Knowles J, Thiele L (2008) Quality assessment of Pareto set approximations. In: Branke J, Deb K, Miettinen K, Slowinski R (eds) Multiobjective optimization: interactive and evolutionary approaches. Springer, Berlin, pp 373–404

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics, The Ohio State University, Columbus, OH, USA

    Thomas J. Santner & William I. Notz

  2. Statistical Sciences Group, Los Alamos National Laboratory, Los Alamos, NM, USA

    Brian J. Williams

Authors
  1. Thomas J. Santner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian J. Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. William I. Notz
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Santner, T.J., Williams, B.J., Notz, W.I. (2018). Some Criterion-Based Experimental Designs. In: The Design and Analysis of Computer Experiments. Springer Series in Statistics. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-8847-1_6

Download citation

Publish with us

Policies and ethics

Search

Navigation