Survey of Current Research

  • Linda Weiser Friedman

Abstract

In a way, simulation metamodels have been with us for a long time. An explicit metamodel was never necessary in order to analyze simulation output data with such statistical techniques as t-est, paired t-est, one-way analysis of variance (ANOVA), multivariate analysis of variance (MANOVA), factorial designs, blocking designs, factor analysis, discriminant analysis, even though these designs all assume an underlying general linear model.

Keywords

Covariance Transportation Turkey Production Line Hunt 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Athanassios, N. Avramidis, and James R. Wilson (1995). “Integrated variance reduction strategies for simulation.” Operations Research, forthcoming.Google Scholar
  2. Barton, Russell R. (1992). “Metamodels for simulation input-output relations.” Proceedings of the Winter Simulation Conference, 289–299.Google Scholar
  3. Barton, Russell R. (1994). “Metamodeling: A state of the art review.” Proceedings of the Winter Simulation Conference, 237–244.Google Scholar
  4. Bauer, K.W., S. Venkatraman, and J.R. Wilson (1987). “Estimation procedures based on control variates with known covariance matrix.” Proceedings of the Winter Simulation Conference, 334–344.Google Scholar
  5. Box, G.E.P. (1954). “The exploration and exploitation of response surfaces.” Biometrics 10, 16–60.CrossRefGoogle Scholar
  6. Burt, J.M., Jr., D.P. Gaver, and M. Perlas (1970). Simple Stochastic Networks: Some problems and procedures.” Naval Research Logistics Quarterly 17, 439–459.MATHCrossRefGoogle Scholar
  7. Cheng, Russell C.H. (1990). “Fitting parametric models by conditional simulation.” Proceedings of the Winter Simulation Conference, 333–336.Google Scholar
  8. Cheng, Russell C.H. and Jack P.C. Kleijnen (1995). “Optimal design of simulation experiments with nearly saturated queues.” Unpublished ms.Google Scholar
  9. Cochran, J.K. and J. Chang (1990). “Optimization of multivariate simulation output models using a group Screening method.” Computers in Industrial Engineering 18, 1, 95–103.CrossRefGoogle Scholar
  10. Cooley, Belva J. and Ernest C. Houck (1982). “A variance-reduction strategy for RSM simulation studies.” Decision Sciences 13, 2 (April).Google Scholar
  11. Donohue, Joan M., Ernest C. Houck, and Raymond H. Myers (1992a). “Sequential experimental designs for simulation metamodeling.” Proceedings of the Winter Simulation Conference, 539–547.Google Scholar
  12. Donohue, Joan M., Ernest C. Houck, and Raymond H. Myers (1992b). “Simulation designs for quadratic response surface models in the presence of model misspecification.” Management Science 38, 12 (December).Google Scholar
  13. Donohue, Joan M., Ernest C. Houck, and Raymond H. Myers (1993a). “A sequential experimental design procedure for the estimation of first- and second-order simulation metamodels.” ACM Transactions on Modeling and Computer Simulation 3, 3 (July), 190–224.MATHCrossRefGoogle Scholar
  14. Donohue, Joan M., Ernest C. Houck, and Raymond H. Myers (1993b). “Simulation designs and correlation induction for reducing second-order bias in first-order response surfaces.” Operations Research 41, 5 (September-October).Google Scholar
  15. Eubank, R.L. (1988). Spline Smoothing and Nonparametric Regression. NY: Marcel Dekker.MATHGoogle Scholar
  16. Franke, Richard (1982). “Scattered data interpolation: Tests of some methods.” Mathematics of Computation 38, 181–200.MathSciNetMATHGoogle Scholar
  17. Friedman, L. W. (1987). “Design and analysis of multivariate response simulations: The State of the Art” Behavioral Science 32, 138–148.CrossRefGoogle Scholar
  18. Friedman, L. W. and H.H. Friedman (1984). “Statistical considerations in simulation: The State of the Art” Journal of Statistical Computation and Simulation 19, 237–263.MathSciNetMATHCrossRefGoogle Scholar
  19. Friedman, L. W. and H.H. Friedman (1985). “Validating the Simulation metamodel: Some practical approaches” Simulation 44, (September), 144–146.CrossRefGoogle Scholar
  20. Friedman, L. W. and I. Pressman (1988). “The metamodel in Simulation analysis: Can it be trusted?” Journal of the Operational Research Society 39, 1–10.Google Scholar
  21. Ghosh, Jay B. (1988). “Evaluating multiprocessor performance: an exercise in metamodeling.” Simulation 51, 2 (August), 70–74.CrossRefGoogle Scholar
  22. Härdie, W. (1990). Applied Nonparametric Regression. Cambridge: Cambridge University Press.Google Scholar
  23. Hopmans, Anton C.M. and Jack P.C. Kleijnen (1980). “Regression estimation in simulation.” The Journal of the Operational Research Society 31, 11 (November), 1033–1038.MathSciNetMATHGoogle Scholar
  24. Hopper, Douglas A., P. Allen Hammer, James R. Wilson (1994). “A simulation model of Rosa hybrida growth response to constant irradiance and day and night temperatures.” Journal of the American Society of Horticultural Science 119, 5, 903–914.Google Scholar
  25. Hussey, James R., Raymond H. Myers, and Ernest C. Houck (1987a). “Correlated simulation experiments in first-order response surface design.” Operations Research 35, 5 (September-October).Google Scholar
  26. Hussey, James R., Raymond H. Myers, and Ernest C. Houck (1987b). “Pseudorandom number assignment in quadratic response surface design.” IIE Transactions 19, 4 (December).Google Scholar
  27. Joshi, Shirish and Jeffrey D. Tew (1993). “Validation and statistical analysis procedures under the common random number correlation-induction strategy for multipopulation simulation experiments.” Unpublished ms.Google Scholar
  28. Kleijnen Jack P.C. (1975). “Antithetic variates, common random numbers and optimal computer time allocation in simulation.” Management Science 27, 1176–1185.CrossRefGoogle Scholar
  29. Kleijnen, Jack P.C. (1983). “Cross-validation using the t statistic.” European Journal of Operational Research 13, 2 (June), 133–141.MATHCrossRefGoogle Scholar
  30. Kleijnen, Jack P.C. (1987). Statistical Tools for Simulation Practitioners. NY: Marcel Dekker.MATHGoogle Scholar
  31. Kleijnen, Jack P.C. (1988). “Analyzing simulation experiments with common random numbers.” Management Science 34, 1 (January), 65–74.CrossRefGoogle Scholar
  32. Kleijnen, Jack P.C. (1992a). “Regression metamodels for simulation with common random numbers: Comparison of validation tests and confidence intervals.” Management Science 38, 8 (August), 1164–1185.MATHCrossRefGoogle Scholar
  33. Kleijnen, Jack P.C. (1992b). “Sensitivity analysis of simulation experiments: Regression analysis and statistical design.” Mathematics and Computers in Simulation 34, 297–315.CrossRefGoogle Scholar
  34. Kleijnen, Jack P.C. (1993). “Simulation and optimization in production planning.” Decision Support Systems 9, 269–280.CrossRefGoogle Scholar
  35. Kleijnen, Jack P.C. (1994a). “Sensitivity analysis and optimization of simulation models.” Proceedings of the European Simulation Symposium, October 9–12, 1994, Istanbul, Turkey, Society for Computer Simulation.Google Scholar
  36. Kleijnen, Jack P.C. (1994b). “Sensitivity analysis versus uncertainty analysis: When to use what?” In J. Grasman and G. van Straten (eds.), Predictability and Nonlinear Modelling in Natural Sciences and Economics, Kluwer Academic, Norwell, MA.Google Scholar
  37. Kleijnen, Jack P.C. (1995a). “Verification and validation of simulation models.” European Journal of Operational Research 82, 145–162.MATHCrossRefGoogle Scholar
  38. Kleijnen, Jack P.C. (1995b). “Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments.” Discussion Paper No. 9504, Center for Economic Research, Tilburg University.Google Scholar
  39. Kleijnen, Jack P.C. (1995c). “Statistical validation of simulation models: A case study.” European Journal of Operational Research, forthcoming.Google Scholar
  40. Kleijnen, Jack and Willem van Groenendaal (1992). Simulation: A Statistical Perspective. NY: Wiley (English translation).MATHGoogle Scholar
  41. Kleijnen, Jack and Willem van Groenendaal (1995). “Two-stage versus sequential sample-size determination in regression analysis of simulation experiments.” American Journal of Mathematical and Management Sciences, forthcoming.Google Scholar
  42. Kleijnen, Jack P.C., Peter C.A. Karremans, Wim K. Oortwijn, and William J.H. van Groenendaal (1987). “Jackknifing estimated weighted least squares: JEWLS” Communication in Statistics, Theory and Methods 16, 3, 747–764.MATHCrossRefGoogle Scholar
  43. Kleijnen, Jack P.C., Jan Rotmans, and Greet van Ham (1992). “Techniques for sensitivity analysis of simulation models: A case study of the CO2 greenhouse effect.” Simulation 58, 6 (June), 410–417.CrossRefGoogle Scholar
  44. Kleijnen, Jack P.C. and Charles R. Standridge (1988). “Experimental design and regression analysis in simulation: An FMS case study.” European Journal of Operational Research 33, 257–261.CrossRefGoogle Scholar
  45. Kuei, Chu-Hua and Christian N. Madu (1994). “Polynomial metamodeling and Taguchi design in simulation with application to the maintenance float system.” European Journal of Operational Research 72, 364–375.MATHCrossRefGoogle Scholar
  46. Kwon, Chimyung and Jeffrey D. Tew (1994a). “Combined correlation methods for metamodel estimation in multipopulation simulation experiments.” Journal of Statistical Computation and Simulation 49, 49–75.MATHCrossRefGoogle Scholar
  47. Kwon, Chimyung and Jeffrey D. Tew (1994b). “Strategies for combining antithetic variates and control variates in designed simulation experiments.” Management Science 40, 8 (August), 1021–1034.MATHCrossRefGoogle Scholar
  48. Lawless, Robert W., Lewis H. Williams, and Charles G. Richie (1971). “A sensitivity analysis tool for simulation with application to disaster planning.” Simulation 17, 6 (December), 217–223.CrossRefGoogle Scholar
  49. Lin, Li and Jeffrey K. Cochran (1990a). “Estimating simulation metamodel parameters for unexpected shop floor real time events.” Computers and Industrial Engineering 19, 1–4.CrossRefGoogle Scholar
  50. Lin, Li and Jeffrey K. Cochran (1990a). “Estimating simulation metamodel parameters for unexpected shop floor real time events.” Computers and Industrial Engineering 19, 62–66.CrossRefGoogle Scholar
  51. Lin, Li and Jeffrey K. Cochran (1990b). “Metamodels of production line transient behavior for sudden machine breakdowns.” International Journal of Production Research 28, 10, 1791–1806.CrossRefGoogle Scholar
  52. Lin, Li, Jeffrey K. Cochran, and Joseph Sarkis (1992). “A metamodel-based decision support system for shop floor production control.” Computers in Industry 18, 155–168.CrossRefGoogle Scholar
  53. McCullagh, P. and J.A. Nelder (1989). Generalized Linear Models. London: Chapman and Hall.MATHGoogle Scholar
  54. Madu, Christian (1990). “Simulation in manufacturing: A regression metamodel.” Computers and Industrial Engineering 18, 3, 381–389.CrossRefGoogle Scholar
  55. Madu, Christian and Michael N. Chanin (1992). “A regression metamodel of a maintenance float problem with erlang-2 failure distribution.” International Journal of Production Research 13, 4, 871–885.Google Scholar
  56. Madu, Christian N. and Chu-Hua Kuei (1992a). “Group screening and Taguchi design in the optimization of multi-echelon maintenance float simulation metamodels.” Computers and Operations Research 19, 2, 95–105.MATHCrossRefGoogle Scholar
  57. Madu, Christian N. and Chu-Hua Kuei (1992b). “Simulation metamodels of system availability and optimum spare and repair units.” IIE Transactions 24, 5 (November), 99–104CrossRefGoogle Scholar
  58. Madu, Christian N. and Chu-Hua Kuei (1994). “Regression metamodeling in computer simulation — The State of Art.” Simulation Practice and Theory 2, 27–41.CrossRefGoogle Scholar
  59. Meidt, Gregory J. and Kenneth W. Bauer Jr. (1992). “PCRSM: A decision support system for simulation metamodel construction.” Simulation 59, 3 (September), 183–191.CrossRefGoogle Scholar
  60. Nozari, Ardavan, Steven F. Arnold, and C. Dennis Pegden (1984). “Control variates for multipopulation simulation experiments.” IIE Transactions 16, (June), 159–169.CrossRefGoogle Scholar
  61. Nozari, Ardavan, Steven F. Arnold, and C. Dennis Pegden (1987). “Statistical analysis for use with the Schruben and Margolin correlation induction strategy.” Operations Research 35, 1 (January-February), 127–139.MATHCrossRefGoogle Scholar
  62. Panis, Renato P., Raymond H. Myers, and Ernest C. Houck (1994). “Combining regression diagnostics with simulation metamodels” European Journal of Operational Research 73, 85–94.MATHCrossRefGoogle Scholar
  63. Percich, David M. (1987). “Modeling the permanent change of station moving costs of strategic airlift pilots.” Unpublished Master’s Thesis, Air Force Institute of Technology.Google Scholar
  64. De O. Porta Nova, Acacio and James R. Wilson (1989). “Estimation of multiresponse simulation metamodels using control variates” Management Science 35, 11 (November), 1316–1333.Google Scholar
  65. De O. Porta Nova, Acacio and James R. Wilson (1993). “Selecting control variates to estimate multiresponse simulation metamodels” European Journal of Operational Research 71, 80–94.MATHCrossRefGoogle Scholar
  66. Pressman, Israel and Linda W. Friedman (1995). “Metamodeling.” In S. Gass and C. Harris (eds.), Encyclopedia of OR/MS. Kluwer Academic, forthcoming.Google Scholar
  67. Ramberg, J.S., S.M. Sanchez, P.J. Sanchez, and L.J. Hollick (1991). “Designing simulation experiments: Taguchi methods and response surface metamodel.” Proceedings of the Winter Simulation Conference, 167–176.Google Scholar
  68. Rao, C.R. (1959). “Some problems involving linear hypotheses in multivariate analysis.” Biometrika 46, 49–58.MathSciNetMATHGoogle Scholar
  69. Rose, Michael R. and R. Harmsen (1978). “Using sensitivity analysis to simplify ecosystem models: A case study.” Simulation 31, 1 (July), 15–26.CrossRefGoogle Scholar
  70. Ross, P.J. (1988). Taguchi Techniques for Quality Engineering. NY: McGraw-Hill.Google Scholar
  71. Rotmans, J. and O.J. Vrieze (1990). “Metamodeling and experimental design: Case study of the greenhouse effect.” European Journal of Operational Research 47, 317–329.MATHCrossRefGoogle Scholar
  72. Sacks, J., W.J. Welch, T.J. Mitchell, and H.P. Wynn (1989). “Design and analysis of computer experiments.” Statistical Science 4, 409–435.MathSciNetMATHCrossRefGoogle Scholar
  73. Safizadeh, M.H. (1990). “Optimization in simulation: Current issues and future outlook.” Naval Research Logistics Quarterly 37, 807–825.MATHCrossRefGoogle Scholar
  74. Safizadeh, M. Hossein and Billy M. Thornton (1982). “An alternative variance-reduction strategy for RSM simulation studies.” Decision Sciences 13, (April), 322–330.CrossRefGoogle Scholar
  75. Sargent, Robert G. (1991). “Research issues in metamodeling.” Proceedings of the Winter Simulation Conference, 888–893.Google Scholar
  76. Schruben, Lee W. (1979). “Designing correlation induction strategies for simulation experiments.” In N. R. Adam and A. Dogramaci (eds.), Current Issues in Computer Simulation, Academic Press, NY.Google Scholar
  77. Schruben, Lee W. and V. James Cogliano (1987). “An experimental procedure for simulation response surface model identification.” Communications of the Association for Computing Machinery 30, 8 (August), 716–730.Google Scholar
  78. Schruben, Lee W. and Barry H. Margolin (1978). “Pseudorandom number assignment in statistically designed simulation and distribution sampling experiments.” Journal of the American Statistical Association 73, 363 (September), 504–520.MathSciNetMATHCrossRefGoogle Scholar
  79. Starbird, S. Andrew (1990). “A metamodel specification for a tomato processing plant.” Journal of the Operational Research Society 41, 3, 229–240.Google Scholar
  80. Starbird, S. Andrew (1991). “The identification of significant terms in a flexible metamodel using spectral analysis.” Transactions of the Society for Computer Simulation 7, 4, 321–338.Google Scholar
  81. Swain, J.J. and B.W. Schmeiser (1989). “Control variates for Monte Carlo analysis of nonlinear models. I. Overview.” Communications in Statistics: B — Simulation and Computation.Google Scholar
  82. Taguchi, C. (1987). System of Experimental Design. NY: Kraus.Google Scholar
  83. Taguchi, C. and Y. Wu (1980). Introduction to Off-line Quality Control. Nagoya, Japan: Central Japan Quality Control Association.Google Scholar
  84. Tew, Jeffrey D. (1989). “Correlation-induction techniques for fitting second-order metamodels in simulation experiments.” Proceedings of the Winter Simulation Conference, 538–546.Google Scholar
  85. Tew, Jeffrey D. (1992a). “Correlated replicates design for first-order metamodel estimation in simulation experiments.” Transactions of the Society for Computer Simulation 8, 4, 218–244.Google Scholar
  86. Tew, Jeffrey D. (1992b). “A study of two correlation-induction techniques for fitting a second-order metamodel in simulation experiments.” Unpublished Working Paper, Dept. of Industrial and Systems Engineering, Virginia Polytechnic Institute and State Univ.Google Scholar
  87. Tew, Jeffrey D. and Marnita D. Crenshaw (1990). “Heuristic diagnostics for the presence of pure error in computer simulation models.” Proceedings of the Winter Simulation Conference, 347–356.Google Scholar
  88. Tew, Jeffrey D. and James R. Wilson (1987). “Metamodel estimation using integrated correlation methods.” Proceedings of the Winter. Simulation Conference, 409–418.Google Scholar
  89. Tew, J.D. and J.R. Wilson (1988). “Estimating simulation metamodels using integrated variance reduction techniques.” Proceedings of the Statistical Computing Section. American Statistical Association, Alexandria Va., 28–32.Google Scholar
  90. Tew, Jeffrey D. and James R. Wilson (1992). “Validation of simulation analysis methods for the Schruben-Margolin correlation induction strategy.” Operations Research 40, 1 (January-February), 87–103.MATHCrossRefGoogle Scholar
  91. Tew, Jeffrey D. and James R. Wilson (1994). “Estimating simulation metamodels using combined correlation-based variance reduction techniques” IIE Transactions 26, 3 (May) 2–16.CrossRefGoogle Scholar
  92. Welch, Peter D. (1990). “Simulation and regression: dealing with the assumption of a common error variance.” Proceedings of the Winter Simulation Conference, 392–394.Google Scholar

Copyright information

© Kluwer Academic Publishers 1996

Authors and Affiliations

  • Linda Weiser Friedman
    • 1
  1. 1.Baruch College School of BusinessThe City University of New YorkUSA

Personalised recommendations