Skip to main content

Some Simulation Results on Cross-Validation and Competitors for Model Choice

  • Conference paper
MODA4 — Advances in Model-Oriented Data Analysis

Part of the book series: Contributions to Statistics ((CONTRIB.STAT.))

Abstract

The behaviour of model selection procedures based on different criteria such as cross-validation is investigated in a simulation study. Emphasis is on the relationship to the problem of estimating the prediction quality of a model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Akaike, H. (1970). Statistical predictor identification. Ann. Inst. Statist. Math. 22, 203–217.

    Article  MathSciNet  MATH  Google Scholar 

  • Akaike, H. (1974). A new look at the statistical model identification. I.E.E.E. Trans. Auto. Control 19, 716–723.

    Article  MathSciNet  MATH  Google Scholar 

  • Bunke, O. and Droge, B. (1984). Bootstrap and cross-validation estimates of the prediction error for linear regression models. Ann. Statist. 12, 1400–1424.

    Article  MathSciNet  MATH  Google Scholar 

  • Bunke, O., Droge, B. and Polzehl, J. (1993). Model selection and variable transformations in nonlinear regression. CORE Discussion Paper No. 9327, C.O.R.E., UCL, Belgium.

    Google Scholar 

  • Chambers, J.M. and Hastie, T. (1992). Statistical Models in S. Wadsworth & Brooks/Cole Computer Science Series, Pacific Grove.

    Google Scholar 

  • Craven, P. and Wahba, G. (1979). Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized cross-validation. Numer. Math. 31 377–403.

    MathSciNet  MATH  Google Scholar 

  • Droge, B. (1993). On finite-sample properties of adaptive least squares regression estimates. Statistics 24, 181–203.

    Article  MathSciNet  MATH  Google Scholar 

  • Droge, B. (1994). Some comments on cross-validation. Discussion Paper No. 7, Sonderforschungsbereich 373, Humboldt-Universität Berlin.

    Google Scholar 

  • Droge, B. and Georg, T. (1995). On selecting the smoothing parameter of least squares regression estimates using the minimax regret approach. Statistics e.4 Decisions 13, 1–20.

    MathSciNet  MATH  Google Scholar 

  • Ellerton, R.R., Kitsos, C.P. and Rinco, S. (1986). Choosing the optimal order of a response polynomial-structural approach with minimax criterion. Comm. Statist. Theory Methods 15, 129–136.

    Article  MathSciNet  MATH  Google Scholar 

  • Eubank, R.L. and Jayasuriya, B.R. (1993). The asymptotic average squared error for polynomial regression. Statistics 24, 311–319.

    Article  MathSciNet  MATH  Google Scholar 

  • Hocking, R.R. (1976). The analysis and selection of variables in linear regression. Biometrics 32, 1–49.

    Article  MathSciNet  MATH  Google Scholar 

  • Mallows, C.L. (1973). Some comments on Cp. Technometrics 15, 661–675.

    MATH  Google Scholar 

  • Müller, M. (1993). Asymptotische Eigenschaften von Modellwahlverfahren in der Regressionsanalyse. Doctoral Thesis, Department of Mathematics, Humboldt University, Berlin (in German).

    Google Scholar 

  • Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist. 6, 461–464.

    Article  MathSciNet  MATH  Google Scholar 

  • Shibata, R. (1981). An optimal selection of regression variables. Biometrika 88, 45–54.

    Article  Google Scholar 

  • Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. J. Roy. Statist. Soc. B 36, 111–147.

    MATH  Google Scholar 

  • Thompson, M.L. (1978). Selection of variables in multiple regression: A review and evaluation. Internat. Statist. Rev. 46, 1–49.

    Article  MathSciNet  MATH  Google Scholar 

  • Thompson, M.L. (1978). Selection of variables in multiple regression: Chosen procedures, computations and examples. Ibid. 46, 129–146.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Droge, B. (1995). Some Simulation Results on Cross-Validation and Competitors for Model Choice. In: Kitsos, C.P., Müller, W.G. (eds) MODA4 — Advances in Model-Oriented Data Analysis. Contributions to Statistics. Physica, Heidelberg. https://doi.org/10.1007/978-3-662-12516-8_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-12516-8_23

  • Publisher Name: Physica, Heidelberg

  • Print ISBN: 978-3-7908-0864-3

  • Online ISBN: 978-3-662-12516-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics