Skip to main content
Log in

Simulation of Errors in Linear Regression: An Approach Based on Fixed Percentage Area

  • Published:
Computational Statistics Aims and scope Submit manuscript

Summary

Recent advances in statistical computation heavily depend on Monte Carlo simulation methods. In many statistical problems, simulated values are used to check or justify any rule whose distributional properties are not known or very difficult to compute. Monte Carlo simulation methods have extensive use in regression analysis. In fact they have formed the basis of regression diagnostics. In linear regression the simulation of a regression model is almost equivalent to simulate the random enors of this model. In the simulation of random errors it is a common practice to generate data from a target distribution with a fixed mean and a fixed variance. We cast our doubt that the fixed variance approach of simulating errors may distort the non-normal shape of any longer-tailed distribution. In this paper we propose a new approach of simulating random errors by fixing the lower percentage area of any target distribution which, we believe, will allow the longer-tailed distribution to be more widely spread than the fixed variance case without doing any harm to a genuine normal case. The usefulness of the proposed approach is investigated through a Monte Carlo power simulation experiment for testing normality of the non-normal errors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Anderson, T.W. and Darling, D.A. (1952). Asymptotic Theory of Certain Goodness-of-Fit Criteria Based on Stochastic Processes. Annals of Mathematical Statistics, 68, 13–20.

    MathSciNet  MATH  Google Scholar 

  • Barnett, V. and Lewis, T. (1994). Outliers in Statistical Data, 3rd ed., Wiley, New York.

    MATH  Google Scholar 

  • Bera, A.K. and Ng, P.T. (1995). Tests for Normality Using Estimated Score Function. Journal of Statistical Computation and Simulation, 52, 273–87.

    Article  Google Scholar 

  • Bowman, K.O. and Shenton, B.R. (1975). Omnibus Test Contours for Departures from Normality Based on \(\sqrt {{b_1}} \) and b 2. Biometrika, 64, 243–50.

    MATH  Google Scholar 

  • Cook, R.D. and Hawkins, D.M. (1990). Comment on ‘Unmasking Multivariate Outliers and Leverage Points.’ by Rousseeuw, P.J. and van Zomeren, B.C., Journal of the American Statistical Association, 85, 640–44.

    Google Scholar 

  • D’Agostino, R.B. (1986). Tests for Normal Distribution. In Goodness-of-fit Techniques, D’Agostino, R.B. and Stephens, M.A. (Eds.), Marcel Dekker, New York, 367–420.

    MATH  Google Scholar 

  • Hawkins, D.M., Bradu, D. and Kass, G.V. (1984). Location of Several Outliers in Multiple Regression Data Using Elemental Sets. Technometrics, 26, 197–208.

    Article  MathSciNet  Google Scholar 

  • Huang, C.J. and Bolch, B.W. (1974). On the Testing of Regression Disturbances for Normality. Journal of the American Statistical Association, 69, 330–35.

    Article  Google Scholar 

  • Judge, G.G., Griffith, W.E., Hill, R.C., Lutkepohl, H. and Lee, T. (1985). Theory and Practice of Econometrics, 2nd ed., Wiley, New York.

    Google Scholar 

  • Rahmatullah Imon, A.H.M. (1999). On PRESS Residuals. Journal of Statistical Research, 33, 57–65.

    MathSciNet  Google Scholar 

  • Rousseeuw, P.J. and Leroy, A. (1987). Robust Regression and Outlier Detection, Wiley, New York.

    Book  Google Scholar 

  • Shapiro, S.S. and Wilk, M.B. (1965). An Analysis of Variance Test for Normality (Complete Samples). Biometrika, 52, 591–611.

    Article  MathSciNet  Google Scholar 

  • Stephens, M.A. (1974). EDF Statistics for Goodness of Fit and Some Comparisons. Journal of the American Statistical Association, 69, 730–37.

    Article  Google Scholar 

  • White, H. and MacDonald, G.M. (1980). Some Large-sample Tests for Nonnormality in the Linear Regression Model. Journal of the American Statistical Association, 75, 16–28.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rahmatullah Imon A.H.M..

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Imon, R. Simulation of Errors in Linear Regression: An Approach Based on Fixed Percentage Area. Computational Statistics 18, 521–531 (2003). https://doi.org/10.1007/BF03354614

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03354614

Key words

Navigation