Statistical Modelling and Regression Structures pp 449-472 | Cite as
Sequential Design of Computer Experiments for Constrained Optimization
Abstract
This paper proposes a sequential method of designing computer or physical experiments when the goal is to optimize one integrated signal function subject to constraints on the integral of a second response function. Such problems occur, for example, in industrial problems where the computed responses depend on two types of inputs: manufacturing variables and noise variables. In industrial settings, manufacturing variables are determined by the product designer; noise variables represent field conditions which are modeled by specifying a probability distribution for these variables. The update scheme of the proposed method selects the control portion of the next input site to maximize a posterior expected “improvement” and the environmental portion of this next input is selected to minimize the mean square prediction error of the objective function at the new control site. The method allows for dependence between the objective and constraint functions. The efficacy of the algorithm relative to the single-stage design and relative to a design assuming independent responses is illustrated. Implementation issues for the deterministic and measurement error cases are discussed as are some generalizations of the method.
Keywords
Computer Experiment Constraint Function Sequential Design Spatial Autoregressive Model Control PortionPreview
Unable to display preview. Download preview PDF.
Notes
Acknowledgments
This work was sponsored, in part, by grants DMS-0406026 and DMS-0806134 (The Ohio State University) from the National Science Foundation. The authors would like to thank Han Gang for computational help.
References
- Bernardo, M. C., Buck, R., Liu, L., Nazaret, W. A., Sacks, J. & Welch, W. J. (1992). Integrated circuit design optimization using a sequential strategy, IEEE Transactions on Computer-Aided Design 11: 361–372.CrossRefGoogle Scholar
- Chang, P. B.,Williams, B. J., Bawa Bhalla, K. S., Belknap, T.W., Santner, T. J., Notz,W. I.&Bartel, D. L. (2001). Robust design and analysis of total joint replacements: Finite element model experiments with environmental variables, Journal of Biomechanical Engineering 123: 239– 246.CrossRefGoogle Scholar
- Currin, C.,Mitchell,T. J.,Morris,M. D.&Ylvisaker,D. (1991). Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments, Journal of the American Statistical Association 86: 953–963.CrossRefMathSciNetGoogle Scholar
- Handcock,M. S.&Stein,M. L. (1993). Abayesian analysis of kriging, Technometrics 35: 403–410.CrossRefGoogle Scholar
- Haylock, R. G. & O’Hagan, A. (1996). On inference for outputs of computationally expensive algorithms with uncertainty on the inputs, in J. Bernardo, J. Berger, A. Dawid & A. Smith (eds), Bayesian Statistics, Vol. 5, Oxford University Press, pp. 629–637.Google Scholar
- Jones, D. R., Schonlau, M. & Welch, W. J. (1998). Efficient global optimization of expensive black–box functions, Journal of Global Optimization 13: 455–492.MATHCrossRefMathSciNetGoogle Scholar
- Kennedy, M. C. & O’Hagan, A. (2000). Predicting the output from a complex computer code when fast approximations are available, Biometrika 87: 1–13.MATHCrossRefMathSciNetGoogle Scholar
- Lehman, J. (2002). Sequential Design of Computer Experiments for Robust Parameter Design, PhD thesis, Department of Statistics, Ohio State University, Columbus, OH USA.Google Scholar
- Nelder, J. A. & Mead, R. (1965). A simplex method for function minimization, Computer Journal 7: 308–313.MATHGoogle Scholar
- O’Hagan, A. (1992). Some bayesian numerical analysis, in J. Bernardo, J. Berger, A. Dawid & A. Smith (eds), Bayesian Statistics, Vol. 4, Oxford University Press, pp. 345–363.Google Scholar
- Ong, L.-T. (2004). Stability of Uncemented Acetabular Components: Design, Patient-Dependent, and Surgical Effects & Complications Due to Trapped Interfacial Fluid, PhD thesis, Sibley School of Mechanical and Aerospace Engineering, Cornell University.Google Scholar
- Sacks, J., Schiller, S. B. & Welch,W. J. (1989). Designs for computer experiments, Technometrics 31: 41–47.CrossRefMathSciNetGoogle Scholar
- Santner, T. J., Williams, B. J. & Notz,W. I. (2003). The Design and Analysis of Computer Experiments, Springer Verlag, New York.MATHGoogle Scholar
- Schonlau, M., Welch, W. J. & Jones, D. R. (1997). Global versus local search in constrained optimization of computer models, Technical Report RR-97-11, University of Waterloo and General Motors.Google Scholar
- Schonlau, M., Welch, W. J. & Jones, D. R. (1998). Global versus local search in constrained optimization of computer models, in N. Flournoy, W. Rosenberger & W. Wong (eds), New Developments and Applications in Experimental Design, Vol. 34, Institute of Mathematical Statistics, pp. 11–25.Google Scholar
- Tang, B. (1993). Orthogonal array-based latin hypercubes, Journal of the American Statistical Association 88: 1392–1397.MATHCrossRefMathSciNetGoogle Scholar
- VerHoef, J. M.&Barry,R. P. (1998). Constructing and fittingmodels for cokriging and multivariable spatial prediction, Journal of Statistical Planning and Inference 69: 275–294.CrossRefMathSciNetGoogle Scholar
- Welch,W. J., Buck, R. J., Sacks, J.,Wynn, H. P.,Mitchell, T. J. &Morris, M. D. (1992). Screening, predicting, and computer experiments, Technometrics 34: 15–25.CrossRefGoogle Scholar
- Williams, B. J., Santner, T. J. & Notz,W. I. (2000a). Sequential design of computer experiments for constrained optimization of integrated response functions, Technical Report 658, Department of Statistics, The Ohio State University.Google Scholar
- Williams, B. J., Santner, T. J. & Notz, W. I. (2000b). Sequential design of computer experiments to minimize integrated response functions, Statistica Sinica 10: 1133–1152.MATHMathSciNetGoogle Scholar