Skip to main content
Log in

Is a small Monte Carlo analysis a good analysis?

Checking the size, power and consistency of a simulation-based test

  • Note
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

In this paper we study the relationship between the number of replications and the accuracy of the estimated quantiles of a distribution obtained by simulation. A method for testing hypotheses on the quantiles of a theoretical distribution using the simulated distribution is proposed, as well as a method to check the hypothesis of consistency of a test.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Cryer, J. B. & Miller, R. B. (1991), Statistics for Business: Data Analysis and Modelling, PWS-KENT publishing Company. Boston.

    Google Scholar 

  • Dfaz-Emparanza, I. (1995), ‘Selectión del número de replicaciones en un estudio de simulation’, Estadística Española 37, 497–509.

    Google Scholar 

  • Dickey, D. & Fuller, W. (1981), ‘Likelihood ratio statistics for autoregressive time series with a unit root’, Econometrica 49, 1057–1071.

    Article  MATH  MathSciNet  Google Scholar 

  • Finster, M. P. (1987), ‘An analysis of five simulation methods for determining the number of replications in a complex monte carlo study’, Statistics & Probability Letters 5, 353–360.

    Article  MATH  MathSciNet  Google Scholar 

  • Hasza, D. & Fuller, W. (1982), ‘Testing for nonstationary parameter specifications in seasonal time series models’, The Annals of Statistics 10, 1209–1216.

    Article  MATH  MathSciNet  Google Scholar 

  • Fz. de Trocóniz, A. (1993), Probabilidades. Estadística. Muestreo., Tebar Flores.

    Google Scholar 

  • Hogg, R. W. & Tanis, E. A. (1988), Probability and Statistical Inference, Macmillan Publishing Company. New York.

    Google Scholar 

  • Hylleberg, S., Engle, R., Granger, C. & Yoo, B. (1990), ‘Seasonal integration and cointegration’, Journal of Econometrics 44, 215–38.

    Article  MATH  MathSciNet  Google Scholar 

  • Johansen, S. (1988), ‘Statistical analysis of cointegration vectors’, Journal of Economic Dynamics and Control 12, 231–254.

    Article  MATH  MathSciNet  Google Scholar 

  • Kleijnen, J. P. C. (1987), Statistical tools for simulation practitioners, Marcel Dekker, Inc., New York.

    MATH  Google Scholar 

  • Kwiatkowski, D., Phillips, P., Schmidt, P. & Shin, Y. (1992), ‘Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root?’, Jornal of Econometrics 54, 159–178.

    Article  MATH  Google Scholar 

  • Stock, J. & Watson, M. (1988), ‘Testing for common trends’, Journal of the American Statistical Association 83, 1097–1107.

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Financial support from research projects PB96-1469-C05-01, UPV-038.321-G55/98 and PI9970 is gratefully acknowledged.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Díaz-Emparanza, I. Is a small Monte Carlo analysis a good analysis?. Statistical Papers 43, 567–577 (2002). https://doi.org/10.1007/s00362-002-0124-9

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-002-0124-9

Keywords

Navigation