Summary
Recent advances in statistical computation heavily depend on Monte Carlo simulation methods. In many statistical problems, simulated values are used to check or justify any rule whose distributional properties are not known or very difficult to compute. Monte Carlo simulation methods have extensive use in regression analysis. In fact they have formed the basis of regression diagnostics. In linear regression the simulation of a regression model is almost equivalent to simulate the random enors of this model. In the simulation of random errors it is a common practice to generate data from a target distribution with a fixed mean and a fixed variance. We cast our doubt that the fixed variance approach of simulating errors may distort the non-normal shape of any longer-tailed distribution. In this paper we propose a new approach of simulating random errors by fixing the lower percentage area of any target distribution which, we believe, will allow the longer-tailed distribution to be more widely spread than the fixed variance case without doing any harm to a genuine normal case. The usefulness of the proposed approach is investigated through a Monte Carlo power simulation experiment for testing normality of the non-normal errors.
Similar content being viewed by others
References
Anderson, T.W. and Darling, D.A. (1952). Asymptotic Theory of Certain Goodness-of-Fit Criteria Based on Stochastic Processes. Annals of Mathematical Statistics, 68, 13–20.
Barnett, V. and Lewis, T. (1994). Outliers in Statistical Data, 3rd ed., Wiley, New York.
Bera, A.K. and Ng, P.T. (1995). Tests for Normality Using Estimated Score Function. Journal of Statistical Computation and Simulation, 52, 273–87.
Bowman, K.O. and Shenton, B.R. (1975). Omnibus Test Contours for Departures from Normality Based on \(\sqrt {{b_1}} \) and b 2. Biometrika, 64, 243–50.
Cook, R.D. and Hawkins, D.M. (1990). Comment on ‘Unmasking Multivariate Outliers and Leverage Points.’ by Rousseeuw, P.J. and van Zomeren, B.C., Journal of the American Statistical Association, 85, 640–44.
D’Agostino, R.B. (1986). Tests for Normal Distribution. In Goodness-of-fit Techniques, D’Agostino, R.B. and Stephens, M.A. (Eds.), Marcel Dekker, New York, 367–420.
Hawkins, D.M., Bradu, D. and Kass, G.V. (1984). Location of Several Outliers in Multiple Regression Data Using Elemental Sets. Technometrics, 26, 197–208.
Huang, C.J. and Bolch, B.W. (1974). On the Testing of Regression Disturbances for Normality. Journal of the American Statistical Association, 69, 330–35.
Judge, G.G., Griffith, W.E., Hill, R.C., Lutkepohl, H. and Lee, T. (1985). Theory and Practice of Econometrics, 2nd ed., Wiley, New York.
Rahmatullah Imon, A.H.M. (1999). On PRESS Residuals. Journal of Statistical Research, 33, 57–65.
Rousseeuw, P.J. and Leroy, A. (1987). Robust Regression and Outlier Detection, Wiley, New York.
Shapiro, S.S. and Wilk, M.B. (1965). An Analysis of Variance Test for Normality (Complete Samples). Biometrika, 52, 591–611.
Stephens, M.A. (1974). EDF Statistics for Goodness of Fit and Some Comparisons. Journal of the American Statistical Association, 69, 730–37.
White, H. and MacDonald, G.M. (1980). Some Large-sample Tests for Nonnormality in the Linear Regression Model. Journal of the American Statistical Association, 75, 16–28.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Imon, R. Simulation of Errors in Linear Regression: An Approach Based on Fixed Percentage Area. Computational Statistics 18, 521–531 (2003). https://doi.org/10.1007/BF03354614
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03354614