Abstract
Simulations are often started from an empty initial system state, which leads to a transient bias from the desired stationary results. This paper compares several state-of-the-art transient removal algorithms and proposes a software framework for a systematic comparison of such algorithms. This helps simulation engineers in selecting a suitable bias-removal algorithm, with special attention to the determination of the quality of the simulation after the removal. It also allows comparison of new bias-removal algorithms against a set of tests, whose implementation would otherwise be time-consuming. A set of quantitative evaluation criteria is also proposed and used for the evaluation of the implemented methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
S. Asmussen, P. Glynn, Stochastic Simulation: Algorithms and Analysis. Stochastic Modelling and Applied Probability, vol. 57 (Springer, Berlin, 2007)
G.S.M. Bertoli, G. Casale, An overview of the JMT queueing network simulator. Tr 2007.2, Politecnico di Milano, DEI (2007)
C.G. Cassandras, S. Lafortune, Introduction to Discrete Event Systems (Kluwer, Boston, 1999)
R.W. Conway, Some tactical problems in digital simulation. Manag. Sci. 10(1), 47–61 (1963)
G.S. Fishman, Bias considerations in simulation experiments. Oper. Res. 20(4), 785–790 (1972)
G.S. Fishman, Monte Carlo: Concepts, Algorithms and Applications. (Springer, New York, 1996)
A. Freeth, A sequential steady-state detection method for quantitative discrete-event simulation. PhD thesis, University of Canterbury (2012)
A.V. Gafarian, C.J. Ancker, T. Morisaku, Evaluation of commonly used rules for detecting “steady state” in computer simulation. Nav. Res. Logist. Q. 25(3), 511–529 (1978)
W.K. Grassmann, Factors affecting warm-up periods in discrete event simulation. Simulation 90(1), 11–23 (2014)
K. Hoad, S. Robinson, R. Davies, Automating warm-up length estimation. J. Oper. Res. Soc. 61, 1389–1403 (2009)
K. Hoad, S. Robinson, R. Davies, AutoSimOA: a framework for automated analysis of simulation output. J. Simul. 5(1), 9–24 (2011)
A.M. Law, D.M. Kelton, Simulation Modeling and Analysis, 3rd edn. (McGraw-Hill Higher Education, New York, 1999)
Y.H. Lee, K.H. Kyung, C.S. Jung, On-line determination of steady state in simulation outputs. Comput. Ind. Eng. 33(3), 805–808 (1997)
P.S. Mahajan, R.G. Ingalls, Evaluation of methods used to detect warm-up period in steady state simulation, in Proceedings of the 36th Conference on Winter Simulation, WSC ’04, Winter Simulation Conference (2004), pp. 663–671
D. McNickle, G.C. Ewing, K. Pawlikowski, Some effects of transient deletion on sequential steady-state simulation. Simul. Modell. Pract. Theory 18(2), 177–189 (2010)
D. Mcnickle, K. Pawlikowski, G. Ewing, AKAROA2: a controller of discrete-event simulation which exploits the distributed computing resources of networks, in Proceedings of European Conference on Modelling and Simulation (ECMS 2010) (2010)
S. Nagaraj, A. Zimmermann. fDRIT - an evaluation tool for transient removal methods in discrete event stochastic simulations, in Proceedings of 10th International Conference on Performance Evaluation Methodologies and Tools (VALUETOOLS 2016), Taormina, October 2016
R. Pasupathy, B. Schmeiser, The initial transient in steady-state point estimation: contexts, a bibliography, the MSE criterion, and the MSER statistic, in Simulation Conference (WSC), Proceedings of the 2010 Winter, December 2010, pp. 184–197
K. Pawlikowski, Steady-state simulation of queueing processes: survey of problems and solutions. ACM Comput. Surv. 22(2), 123–170 (1990)
L. Schruben, Confidence interval estimation using standardized time series. Oper. Res. 31(6), 1090–1108 (1983)
L. Schruben, H. Singh, L. Tierney, Optimal tests for initialization bias in simulation output. Oper. Res. 31(6), 1167–1178 (1983)
K.P. White, A simple rule for mitigating initialization bias in simulation output: comparative results, in IEEE International Conference on Systems, Man and Cybernetics, 1995. Intelligent Systems for the 21st Century, October 1995, vol. 1, pp. 206–211
K.P. White, M.A. Minnox, Minimizing initialization bias in simulation output using a simple heuristic, in Proceedings of IEEE International Conference on Systems, Man and Cybernetics, October 1994, vol. 1, pp. 215–220
S. Yousefi, MSER-5Y: an improved version of MSER-5 with automatic confidence interval estimation. Master’s thesis, North Carolina State University (2011)
A. Zimmermann, Stochastic Discrete Event Systems (Springer, Berlin, 2007)
A. Zimmermann, Modelling and performance evaluation with TimeNET 4.4, in Quantitative Evaluation of Systems - 14th International Conference, QEST 2017, pp. 300–303, Berlin, September 2017
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Nagaraj, S., Zimmermann, A. (2019). A Software Tool for the Evaluation of Transient Removal Methods in Discrete Event Stochastic Simulations. In: Puliafito, A., Trivedi, K. (eds) Systems Modeling: Methodologies and Tools. EAI/Springer Innovations in Communication and Computing. Springer, Cham. https://doi.org/10.1007/978-3-319-92378-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-92378-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92377-2
Online ISBN: 978-3-319-92378-9
eBook Packages: EngineeringEngineering (R0)